As outlined in Bulk Data Downloads, filenames and URL's are limited (in the cloud) to 200 characters. How can I override this URL length limit when executing a back test (or live trade) in the cloud?
Additional Info:
For this example, I am using the download method to request some ExDiv and related data from Polygon.io. Polygon may respond with a long (potentally more than 200 characters long) pagination url, which is then used to download the next page of data.
Is there a config or other method for increasing this 200 character limit? Why is it there, for the cloud, in the first place?
Note: There does not seem to be the same restriction on the local lean engine.
Mia Alissi
The 200 character limit for filenames and URLs in the cloud is a design decision made by QuantConnect to ensure efficient operation and prevent potential issues with excessively long URLs or filenames. This limit applies to both backtesting and live trading in the QuantConnect Cloud.
Unfortunately, there is no configuration or method available to override this limit. It's a hard limit set within the QuantConnect system and cannot be changed by users.
If you're dealing with URLs that may exceed this limit, you might need to consider alternative ways to handle your data. For example, if you're storing your custom data in Google Sheets, you could create a link to the file and choose the CSV format to find
/pub?gid={SHEET_ID}&single=true&output=csv
parameter on the end of the link. Google Sheets don't support exporting data in JSON format. sourceIf you need to import more files than your quota allows, you can save your custom data files in the Object Store and load them from there. source
As for the local Lean engine, it doesn't have the same restrictions because it operates in a different environment and doesn't have the same constraints as the cloud-based system.
The material on this website is provided for informational purposes only and does not constitute an offer to sell, a solicitation to buy, or a recommendation or endorsement for any security or strategy, nor does it constitute an offer to provide investment advisory services by QuantConnect. In addition, the material offers no opinion with respect to the suitability of any security or specific investment. QuantConnect makes no guarantees as to the accuracy or completeness of the views expressed in the website. The views are subject to change, and may have become unreliable for various reasons, including changes in market conditions or economic circumstances. All investments involve risk, including loss of principal. You should consult with an investment professional before making any investment decisions.
Gary Rosner
The material on this website is provided for informational purposes only and does not constitute an offer to sell, a solicitation to buy, or a recommendation or endorsement for any security or strategy, nor does it constitute an offer to provide investment advisory services by QuantConnect. In addition, the material offers no opinion with respect to the suitability of any security or specific investment. QuantConnect makes no guarantees as to the accuracy or completeness of the views expressed in the website. The views are subject to change, and may have become unreliable for various reasons, including changes in market conditions or economic circumstances. All investments involve risk, including loss of principal. You should consult with an investment professional before making any investment decisions.
To unlock posting to the community forums please complete at least 30% of Boot Camp.
You can continue your Boot Camp training progress from the terminal. We hope to see you in the community soon!