Extremely slow load times when reading in analysis.tsf and analysis.tdf SQLite databases using pd.read_sql_query. Example dataset had over 700k rows and took over 45 min. Preliminary research says this is due to pd.read_sql_query being written in Python?
May need to prevent reading all tables/views when initializing TsfData and TdfData and instead turn getting each table into a method?
Extremely slow load times when reading in analysis.tsf and analysis.tdf SQLite databases using pd.read_sql_query. Example dataset had over 700k rows and took over 45 min. Preliminary research says this is due to pd.read_sql_query being written in Python?
May need to prevent reading all tables/views when initializing TsfData and TdfData and instead turn getting each table into a method?