Lean using Local CSV files

Hi Mathew

Please make sure you put the CSV file in the \data file under the directory where you do lean init.

Then the source line needs to be changed into (for example, the custom_weather_data.csv file in the image):

source = os.path.join(Globals.DataFolder, "custom_weather_data.csv")

Best
Louis

I thought a very similar thing, so I tried the following to confirm that the location path was correct:

    def GetSource(self, config, date, isLiveMode):
        # Get file specific to the asset symbol
        symbol = config.Symbol.Value

        ##Get Path for SYM
        file = CSV_FILES.get(symbol)

        with open("%s/%s.txt" % (Globals.DataFolder,symbol), 'w') as f:
            f.write(file)

        # ##local files return
        return  SubscriptionDataSource(
            file,SubscriptionTransportMedium.LocalFile)

this does indeed save a text file inside the container which is then intern saved into my data folder for Lean:

the content of that file , is as you would expect:

to further investigate I went one step further… as I wanted to know if the data was actually moving over to the container.  So I took the above function, used the file location given by the path and then copied the file.  the file indeed is in the data folder.

so I can for certain say that the file is there with in the container.  What other steps can I take to debug this?  literally the only thing that has changed is the file is local vs remote.  it is the exact same file from dropbox.

to maybe add more context.  I did a similar write line in the 

def Reader(self, config, line, date, isLiveMode):

when I run the “get source” with the remote file the Reader is called. and my generic text file is wrote to.  However, if I use the local file the “Reader” is never even called…. so it seems it is not even making it to Reader with the local files. however,  I am certain the local files are there

Hi Matthew

We are unable to reproduce your problem. Could you please attach the whole PythonData class (including both GetSource and Reader methods) and the full path of your .csv/.txt file for further assistance?

Please also check if the data is saved on Launcher\bin\Debug\cache\data with a hash-like name like Launcher\bin\Debug\cache\data\3e9e7604efe3499e0b452ca237261087.csv

Best
Louis