2021-08-26 18:10:56,479 INFO already downloaded!
2021-08-26 18:10:56,479 INFO ./outputs/goes//raws//20212381758554_C13.nc
2021-08-26 18:10:56,479 INFO already downloaded!
2021-08-26 18:10:56,480 INFO Querying:
2021-08-26 18:10:56,480 INFO ABI-L2-CMIPC/2021/238/18/
2021-08-26 18:10:56,819 INFO ./outputs/goes//raws//20212381803555_C13.nc
2021-08-26 18:10:56,819 INFO already downloaded!
2021-08-26 18:11:27,402 ERROR Traceback (most recent call last):
2021-08-26 18:11:27,403 ERROR File "/opt/conda/lib/python3.8/site-packages/urllib3/response.py", line 436, in _error_catcher
2021-08-26 18:11:27,403 ERROR yield
2021-08-26 18:11:27,403 ERROR File "/opt/conda/lib/python3.8/site-packages/urllib3/response.py", line 518, in read
2021-08-26 18:11:27,403 ERROR data = self._fp.read(amt) if not fp_closed else b""
2021-08-26 18:11:27,403 ERROR File "/opt/conda/lib/python3.8/http/client.py", line 458, in read
2021-08-26 18:11:27,404 ERROR n = self.readinto(b)
2021-08-26 18:11:27,404 ERROR File "/opt/conda/lib/python3.8/http/client.py", line 502, in readinto
2021-08-26 18:11:27,404 ERROR n = self.fp.readinto(b)
2021-08-26 18:11:27,404 ERROR File "/opt/conda/lib/python3.8/socket.py", line 669, in readinto
2021-08-26 18:11:27,404 ERROR return self._sock.recv_into(b)
2021-08-26 18:11:27,404 ERROR File "/opt/conda/lib/python3.8/ssl.py", line 1241, in recv_into
2021-08-26 18:11:27,416 ERROR return self.read(nbytes, buffer)
2021-08-26 18:11:27,417 ERROR File "/opt/conda/lib/python3.8/ssl.py", line 1099, in read
2021-08-26 18:11:27,417 ERROR return self._sslobj.read(len, buffer)
2021-08-26 18:11:27,417 ERROR ConnectionResetError
2021-08-26 18:11:27,417 ERROR :
2021-08-26 18:11:27,417 ERROR [Errno 104] Connection reset by peer
2021-08-26 18:11:27,417 ERROR
During handling of the above exception, another exception occurred:
2021-08-26 18:11:27,417 ERROR Traceback (most recent call last):
2021-08-26 18:11:27,417 ERROR File "looper_goes16aws.py", line 185, in <module>
2021-08-26 18:11:27,431 ERROR main(outdir, creds, sleep=90.,
2021-08-26 18:11:27,431 ERROR File "looper_goes16aws.py", line 107, in main
2021-08-26 18:11:27,431 ERROR ffiles = aws.GOESAWSgrab(aws_keyid, aws_secretkey, when, dout,
2021-08-26 18:11:27,431 ERROR File "/home/lig/Codes/NightShift/nightshift/goes/aws.py", line 124, in GOESAWSgrab
2021-08-26 18:11:27,436 ERROR com.aws.downloadFromS3(buck, objs, oname)
2021-08-26 18:11:27,436 ERROR File "/home/lig/Codes/NightShift/nightshift/common/aws.py", line 43, in downloadFromS3
2021-08-26 18:11:27,437 ERROR buck.download_file(objs.key, oname)
2021-08-26 18:11:27,437 ERROR File "/opt/conda/lib/python3.8/site-packages/boto3/s3/inject.py", line 244, in bucket_download_file
2021-08-26 18:11:27,445 ERROR return self.meta.client.download_file(
2021-08-26 18:11:27,445 ERROR File "/opt/conda/lib/python3.8/site-packages/boto3/s3/inject.py", line 170, in download_file
2021-08-26 18:11:27,445 ERROR return transfer.download_file(
2021-08-26 18:11:27,445 ERROR File "/opt/conda/lib/python3.8/site-packages/boto3/s3/transfer.py", line 307, in download_file
2021-08-26 18:11:27,449 ERROR future.result()
2021-08-26 18:11:27,449 ERROR File "/opt/conda/lib/python3.8/site-packages/s3transfer/futures.py", line 106, in result
2021-08-26 18:11:27,449 ERROR return self._coordinator.result()
2021-08-26 18:11:27,449 ERROR File "/opt/conda/lib/python3.8/site-packages/s3transfer/futures.py", line 265, in result
2021-08-26 18:11:27,456 ERROR raise self._exception
2021-08-26 18:11:27,456 ERROR File "/opt/conda/lib/python3.8/site-packages/s3transfer/tasks.py", line 126, in __call__
2021-08-26 18:11:27,456 ERROR return self._execute_main(kwargs)
2021-08-26 18:11:27,456 ERROR File "/opt/conda/lib/python3.8/site-packages/s3transfer/tasks.py", line 150, in _execute_main
2021-08-26 18:11:27,457 ERROR return_value = self._main(**kwargs)
2021-08-26 18:11:27,457 ERROR File "/opt/conda/lib/python3.8/site-packages/s3transfer/download.py", line 521, in _main
2021-08-26 18:11:27,457 ERROR for chunk in chunks:
2021-08-26 18:11:27,457 ERROR File "/opt/conda/lib/python3.8/site-packages/s3transfer/download.py", line 649, in __next__
2021-08-26 18:11:27,463 ERROR chunk = self._body.read(self._chunksize)
2021-08-26 18:11:27,463 ERROR File "/opt/conda/lib/python3.8/site-packages/s3transfer/utils.py", line 570, in read
2021-08-26 18:11:27,475 ERROR value = self._stream.read(*args, **kwargs)
2021-08-26 18:11:27,475 ERROR File "/opt/conda/lib/python3.8/site-packages/botocore/response.py", line 77, in read
2021-08-26 18:11:27,479 ERROR chunk = self._raw_stream.read(amt)
2021-08-26 18:11:27,479 ERROR File "/opt/conda/lib/python3.8/site-packages/urllib3/response.py", line 540, in read
2021-08-26 18:11:27,479 ERROR raise IncompleteRead(self._fp_bytes_read, self.length_remaining)
2021-08-26 18:11:27,480 ERROR File "/opt/conda/lib/python3.8/contextlib.py", line 131, in __exit__
2021-08-26 18:11:27,497 ERROR self.gen.throw(type, value, traceback)
2021-08-26 18:11:27,497 ERROR File "/opt/conda/lib/python3.8/site-packages/urllib3/response.py", line 454, in _error_catcher
2021-08-26 18:11:27,497 ERROR raise ProtocolError("Connection broken: %r" % e, e)
2021-08-26 18:11:27,497 ERROR urllib3.exceptions
2021-08-26 18:11:27,497 ERROR .
2021-08-26 18:11:27,497 ERROR ProtocolError
2021-08-26 18:11:27,497 ERROR :
2021-08-26 18:11:27,497 ERROR ("Connection broken: ConnectionResetError(104, 'Connection reset by peer')", ConnectionResetError(104, 'Connection reset by peer'))
A rare crash! First I've seen of this one