Rolling Window of Consolidated bars

Luke Algo,

Try this, talib compatible.

The same one with gap chart.

I tried using code similar to yours except I have the resolution of my add equity set to 1 minute as this is the time frame I want to work with other than for the consolidator. 

self.AddEquity("AMD", Resolution.Minute, Market.USA, True, 1, False)

When I run it it's still coming up with strange numbers. For example for on 2020-4-15 its showing the open of the consolidated bar to be 52.16 and the previous close to be 50.94, but when I look up that date for AMD for those times it never dropped to those prices. It looks like those are the values for the day before what they should be. The value that should be today's open value is yesterdays open value and the value that should be yesterdays close close value is the day before yesterdays close value. Also, the value the close value is correct in that it is the value at market close, however the open value is the value that happened at the open of premarket and not at the open of the actual market. I have extended hours set to False in AddEquity so I'm not sure why the consolidated bars open is at the beginning of premarket.

I believe I solved the problem for anyone who is trying to do something similar. Instead of using a consolidator I used object store to save the close values at the relevant times of day and delete the previous days saved data.

Hi Luke,

Consolidators consolidate all of yesterday's data for one bar for today. However, we can still get today's open through the Consolidator by accessing its .WorkingBar for the current bar in progress, and I've shown this in the attached backtest.

Best,
Shile Wen

Shile Wen, I've tried using your code. For some reason the data isn't matching TradingView's charts at all. I believe I may need to make it so that the bar starts at 9:30 to get that correct data. Is there a way to do this? Also, does setting the timedelta(1) make it a daily bar or do I need to add in the resolution as well?

Ok, I've tried to implement the custom start and end times. There aren't many examples of it I could find, but this is what I have at this point:

		
		
class EMACrossover(QCAlgorithm):		
	def Initialize(self):	
		self.SetStartDate(2020, 4, 1)
        self.SetEndDate(2021, 4, 27)
        self.SetCash(10000)
        self.SetWarmUp(150)




        

        self.AddEquity("AMD", Resolution.Minute, Market.USA, True, 1, True)
        self.sym ="AMD"


	#Rolling window and consolidator used for comparing yesterdays close to today's open

		self.gapwindow = RollingWindow[TradeBar](2)
 
		self.consolidator = TradeBarConsolidator(self.Customstart)
		self.consolidator.DataConsolidated += self.consolidation_handler
		self.SubscriptionManager.AddConsolidator(self.sym, self.consolidator)
	def consolidation_handler(self, sender, bar):
		self.gapwindow.Add(bar)
	def Customstart(self, dt):
		start = dt.replace(hour=9, minute=30)
    	end = dt.replace(hour=16, minute=00)
    	return CalendarInfo(start, end - start)

I'm not sure where I went wrong, but it's giving me an error that says:

FuncPeriodSpecification: Please use a function that computes a date/time in the past (e.g.: Time.StartOfWeek and Time.StartOfMonth)

I've changed the Customstart portion from above to:

def Customstart(self, dt):
       start = dt.replace(day=1, hour=9, minute=30)
       end = dt.replace(day=1, hour=16, minute=00)
       return CalendarInfo(start, end - start) 
 

I'm no longer getting the error and the algorithm will run, but the data doesn't seem to be right at all. On a lot of the data for the consolidated bars the price on tradingview never even went near the open or the close for the consolidated bars in the period the consolidated bar is supposed to represent. I'm still not sure what the issue is. If anyone could point me in the right direction I would greatly appreciate it. I'm basically just trying to create a daily bar out of minute bars that I can use to get the previous days market close and the open of the working bar for today's market open.

Is there anything wrong with getting GAP data this way?

The values your way seem to be pretty close. The reason I wasn't trying to do it this way is because I have to set the after hours data to false. I don't need the after hours data right now, but in the future it would be good to be able to have the ability to turn it on if I need it for some other strategy or indicator that I program, while still having this gap finder work correctly.

Hi Luke,

To consolidate the data from open to close when subscribed to extended market data, we need to update the consolidator manually.

if self.sym in data.Bars:
   bar = data.Bars[self.sym]
   time_of_day = bar.EndTime.time() 
   if time_of_day > time(9, 30) and time_of_day < time(16, 00):
       self.consolidator.Update(bar)

Instead of using a RollingWindow, a single variable will suffice because we only need to save 1 trailing bar at any given time. See the attached backtest for a working example. The cells in the notebook show the OHLC values of the consolidated bars in this example closely match the values of the regular daily bars.

Best,
Derek Melchin