Bug - Docker Quick Setup - Fails with sector data

[bordumb]

Hi!

First off, this is an awesome looking project!

Steps to reproduce

• Clone the repo
• Go into requirements.txt and get rid of all the version numbers (I had an issue where the pandas version originally there threw errors that caused the docker build to not work at all)
• Run through all 6 steps
• Run docker-compose up app

What worked

• All the tables were created in Postgres (awesome!)
• csidata_stock_factsheet table was filled
• data_vendor table was filled
• exchanges table was filled
• symbology table was filled

What did not work

• No other tables were filled

What is the possible cause

The last error message I got was this one:

pysecmaster | Downloading the NASDAQ sector and industry data for the following exchanges: ['NASDAQ', 'NYSE', 'AMEX']
pysecmaster | Remote end closed connection without response
pysecmaster | Traceback (most recent call last):
pysecmaster |   File "/download.py", line 1265, in download_data
pysecmaster |     return urlopen(url)
pysecmaster |   File "/usr/local/lib/python3.9/urllib/request.py", line 214, in urlopen
pysecmaster |     return opener.open(url, data, timeout)
pysecmaster |   File "/usr/local/lib/python3.9/urllib/request.py", line 517, in open
pysecmaster |     response = self._open(req, data)
pysecmaster |   File "/usr/local/lib/python3.9/urllib/request.py", line 534, in _open
pysecmaster |     result = self._call_chain(self.handle_open, protocol, protocol +
pysecmaster |   File "/usr/local/lib/python3.9/urllib/request.py", line 494, in _call_chain
pysecmaster |     result = func(*args)
pysecmaster |   File "/usr/local/lib/python3.9/urllib/request.py", line 1371, in http_open
pysecmaster |     return self.do_open(http.client.HTTPConnection, req)
pysecmaster |   File "/usr/local/lib/python3.9/urllib/request.py", line 1346, in do_open
pysecmaster |     r = h.getresponse()
pysecmaster |   File "/usr/local/lib/python3.9/http/client.py", line 1347, in getresponse
pysecmaster |     response.begin()
pysecmaster |   File "/usr/local/lib/python3.9/http/client.py", line 307, in begin
pysecmaster |     version, status, reason = self._read_status()
pysecmaster |   File "/usr/local/lib/python3.9/http/client.py", line 276, in _read_status
pysecmaster |     raise RemoteDisconnected("Remote end closed connection without"
pysecmaster | http.client.RemoteDisconnected: Remote end closed connection without response
pysecmaster | 
pysecmaster | During handling of the above exception, another exception occurred:
pysecmaster | 
pysecmaster | Traceback (most recent call last):
pysecmaster |   File "//pySecMaster.py", line 551, in <module>
pysecmaster |     maintenance(database_options=test_database_options,
pysecmaster |   File "//pySecMaster.py", line 190, in maintenance
pysecmaster |     NASDAQSectorIndustryExtractor(
pysecmaster |   File "/extractor.py", line 1467, in __init__
pysecmaster |     self.main()
pysecmaster |   File "/extractor.py", line 1482, in main
pysecmaster |     raw_df = download_nasdaq_industry_sector(self.db_url,
pysecmaster |   File "/download.py", line 1362, in download_nasdaq_industry_sector
pysecmaster |     csv_file = download_data(url=url_string)
pysecmaster |   File "/download.py", line 1353, in download_data
pysecmaster |     raise OSError('Warning: Encountered an unknown error when '
pysecmaster | OSError: Warning: Encountered an unknown error when downloading data in download_data in download.py
pysecmaster exited with code 1