Share New Research 
Hey! Just wanted to share a tool that I've been using to gather data from webpages and schedule scraping every couple of minutes/hours. It's called Data Scraping Studio and can be downloaded from http://www.datascraping.co/. I made an agent to gather data from https://ca.finance.yahoo.com/gainers?e=US I've modified that data with a simple javascript filter to meet a specific criteria. Price less than 5, Volume greater than 100000, Maximum gain. The studio will output a file to the dropbox folder on my computer every 10 minutes. In the algorithm I've attached you'll see that it will purchase the top symbol for the day and check the current time against the date and time within the csv file. This algorithm with notify you if there is a DateTime mismatch to prevent it from buying the previous days symbol. If something was to happen locally with your scheduled scraping then it wont attempt to buy anything. Hope this helps some people having similar questions/issues.
QUANTCONNECT COMMUNITY
The material on this website is provided for informational purposes only and does not constitute an offer to sell, a solicitation to buy, or a recommendation or endorsement for any security or strategy, nor does it constitute an offer to provide investment advisory services by QuantConnect. In addition, the material offers no opinion with respect to the suitability of any security or specific investment. QuantConnect makes no guarantees as to the accuracy or completeness of the views expressed in the website. The views are subject to change, and may have become unreliable for various reasons, including changes in market conditions or economic circumstances. All investments involve risk, including loss of principal. You should consult with an investment professional before making any investment decisions.
QuantConnect™ 2024. All Rights Reserved
Stephen Oehler
This is beyond awesome. I literally had no idea such a tool existed. Thanks for this contribution, Travis.
Travis Teichelmann
The material on this website is provided for informational purposes only and does not constitute an offer to sell, a solicitation to buy, or a recommendation or endorsement for any security or strategy, nor does it constitute an offer to provide investment advisory services by QuantConnect. In addition, the material offers no opinion with respect to the suitability of any security or specific investment. QuantConnect makes no guarantees as to the accuracy or completeness of the views expressed in the website. The views are subject to change, and may have become unreliable for various reasons, including changes in market conditions or economic circumstances. All investments involve risk, including loss of principal. You should consult with an investment professional before making any investment decisions.
To unlock posting to the community forums please complete at least 30% of Boot Camp.
You can continue your Boot Camp training progress from the terminal. We hope to see you in the community soon!