Hi,

I want to generate random data in a docker / CLI environement on WSL2 (Ubuntu). I was able to install the Lean CLI and connect to the Jupyter Notebook. However generating data fails with an error.

Lean version: 1.0.210

Docker image: quantconnect/lean  latest    5fa9ada4e3eb (date: 20241216)

Command:

  1. lean data generate --start 20240101 --end 20240105 --tickers spy --security-type equity --resolution minuted

I the multiple errors:

  1. System.IO.FileLoadException: Could not load file or assembly 'System.Collections.Immutable, Version=7.0.0.0, Culture=neutral, 
  2. PublicKeyToken=b03f5f7f11d50a3a'. Could not find or load a specific file. (0x80131621)
  3. File name: 'System.Collections.Immutable, Version=7.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a'
  4.  ---> System.IO.FileLoadException: Could not load file or assembly 'System.Collections.Immutable, Version=8.0.0.0, Culture=neutral, 
  5. PublicKeyToken=b03f5f7f11d50a3a'.
  6.    at System.Runtime.Loader.AssemblyLoadContext.LoadFromPath(IntPtr ptrNativeAssemblyLoadContext, String ilPath, String niPath, ObjectHandleOnStack 
  7. retAssembly)

I assume, the data is generated in the docker container, therefore I think the issue must be there.

The image  inspect output is here: 

  1. docker image inspect 5fa9ada4e3eb
  2. [
  3.     {
  4.         "Id": "sha256:5fa9ada4e3ebf5156f98a194dbab6953163079ab3c42174a02b8a3b48fdd690f",
  5.         "RepoTags": [
  6.             "quantconnect/lean:latest"
  7.         ],
  8.         "RepoDigests": [
  9.             "quantconnect/lean@sha256:3bf08e3d8fa6cec7d09112d4cc150e0ff4ca0d39961e71bc186e3a54f888c6b0"
  10.         ],
  11.         "Parent": "",
  12.         "Comment": "buildkit.dockerfile.v0",
  13.         "Created": "2024-12-16T14:57:21.495370934Z",
  14.         "DockerVersion": "",
  15.         "Author": "QuantConnect <contact@quantconnect.com>",
  16.         "Config": {
  17.             "Hostname": "",
  18.             "Domainname": "",
  19.             "User": "",
  20.             "AttachStdin": false,
  21.             "AttachStdout": false,
  22.             "AttachStderr": false,
  23.             "Tty": false,
  24.             "OpenStdin": false,
  25.             "StdinOnce": false,
  26.             "Env": [
  27.                 "PATH=/opt/miniconda3/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin",
  28.                 "DEBIAN_FRONTEND=teletype",
  29.                 "LANG=en_US.UTF-8",
  30.                 "LANGUAGE=en_US:en",
  31.                 "LC_ALL=en_US.UTF-8",
  32.                 "PYTHONNET_PYDLL=/opt/miniconda3/lib/libpython3.11.so",
  33.                 "CONDA=Miniconda3-py311_24.9.2-0-Linux-x86_64.sh",
  34.                 "PIP_DEFAULT_TIMEOUT=120",
  35.                 "CUDA_MODULE_LOADING=LAZY",
  36.                 "XLA_FLAGS=--xla_gpu_cuda_data_dir=/opt/miniconda3/",
  37.                 "LD_LIBRARY_PATH=:/opt/miniconda3/lib/python3.11/site-packages/nvidia/cublas/lib/:/opt/miniconda3/lib/python3.11/site-packages/nvidia/cuda_cupti/lib/:/opt/miniconda3/lib/python3.11/site-packages/nvidia/cuda_nvrtc/lib/:/opt/miniconda3/lib/python3.11/site-packages/nvidia/cuda_runtime/lib/:/opt/miniconda3/lib/python3.11/site-packages/nvidia/cudnn/lib/:/opt/miniconda3/lib/python3.11/site-packages/nvidia/cufft/lib/:/opt/miniconda3/lib/python3.11/site-packages/nvidia/curand/lib/:/opt/miniconda3/lib/python3.11/site-packages/nvidia/cusolver/lib/:/opt/miniconda3/lib/python3.11/site-packages/nvidia/cusparse/lib/:/opt/miniconda3/lib/python3.11/site-packages/nvidia/nccl/lib/:/opt/miniconda3/lib/python3.11/site-packages/nvidia/nvjitlink/lib/:/opt/miniconda3/lib/python3.11/site-packages/nvidia/nvtx/lib/",
  38.                 "PYTORCH_CUDA_ALLOC_CONF=expandable_segments:True"
  39.             ],
  40.             "Cmd": null,
  41.             "ArgsEscaped": true,
  42.             "Image": "",
  43.             "Volumes": null,
  44.             "WorkingDir": "/Lean/Launcher/bin/Debug",
  45.             "Entrypoint": [
  46.                 "dotnet",
  47.                 "QuantConnect.Lean.Launcher.dll"
  48.             ],
  49.             "OnBuild": null,
  50.             "Labels": {
  51.                 "lean_version": "16790",
  52.                 "python_version": "3.11",
  53.                 "strict_python_version": "3.11.11",
  54.                 "target_framework": "net6.0"
  55.             }
  56.         },
  57.         "Architecture": "amd64",
  58.         "Os": "linux",
  59.         "Size": 29626836356,
  60.         "GraphDriver": {
  61.             "Data": {
  62.                 "LowerDir": "/var/lib/docker/overlay2/d980dc4d96bf6e41b09a1869b1c346d4209b04cf9b9e7c15d2e2b2a3d671fb42/diff:/var/lib/docker/overlay2/a2f46727938159b6fa53dc13607c55c84a3a80a2f091af56ce8d8c1e5e37b11e/diff:/var/lib/docker/overlay2/18f384a8361d7fb27e72fe96e7ff5004f7a6ef33fc0db7c47e5e5bcce0c398cb/diff:/var/lib/docker/overlay2/1ea4475af33dc173f84cb0357ea0162d7f6467ea4f35e3bcfea9495decc1998d/diff:/var/lib/docker/overlay2/f1033f98d848f3ea7ee6bc739e0d1e933314a6716ca3026e222c38dcd28c16f0/diff:/var/lib/docker/overlay2/13fa7688975d5c551c53c3d84df887acbad1e4fc59812bafdd0b57b22de2400d/diff:/var/lib/docker/overlay2/11843e023355179f45c6370050e20d76b42f733f2048f062fcf9faf77748d09d/diff:/var/lib/docker/overlay2/2a9ea44e06e747835773488914d13fa959e4d85c6b4f1fd6cc47a2282f80719d/diff:/var/lib/docker/overlay2/1e85991673bf595c25d487b9dc2593e05131d7889f5aaae96a2e5120c0e4e7ee/diff:/var/lib/docker/overlay2/0ba969852ea24d6211720a6c59ddacb6465588ada5f758e3cb67063d7cdef168/diff:/var/lib/docker/overlay2/a9bb8b7adc25bad60a5975a3aa98a957fb22fec2f2dcab073ac21a6ebd3eee4b/diff:/var/lib/docker/overlay2/17df625118cf72cb6ef82afd227522fcd38639f906fcf6132fa78d2c96d2502d/diff:/var/lib/docker/overlay2/d35019d3ca04448209a9ddee6ec95f353405b12dcd66087735a4720715e3cef8/diff:/var/lib/docker/overlay2/c24ce2f93ecb7c4e867eb33f1dbdee84e59e60ebc5edde4dba2a55244af05d44/diff:/var/lib/docker/overlay2/919506c3edb611ffc1250223c736a9cd38c1f6c4752dba409851a54470586bad/diff:/var/lib/docker/overlay2/835e5726e5dd73ca4897054115d8b7a3eb9ff6cee6741ec3e9147638457a913a/diff:/var/lib/docker/overlay2/19f4b1c379a62ae14dafbefe91d8359e839df948f982cc76bc7682737f3bd571/diff:/var/lib/docker/overlay2/57d0825711aaadbad3064a89544d842c9c609db474f4cbfade037c4f78c82fc6/diff:/var/lib/docker/overlay2/d5646fbcd701f80b3e514f645d161732496016bc31a86cba463ad78d1dff7a0c/diff:/var/lib/docker/overlay2/e84a6eaaaba098f9fddc693343c2a0c9f1a315f40df8f4ddcf9cd8eb4e10ac94/diff:/var/lib/docker/overlay2/6758a7a83a4cedd7e9a79f9626f8dbe94b840d902405dce686b3e0d67d1b1939/diff:/var/lib/docker/overlay2/a2010a60ebab2272ee2c9af9589a8a6f999b7c94e761866ee2af00ca80cf64c6/diff:/var/lib/docker/overlay2/d7d683450c4f4d7ba2365214ddcc6a88586ba8c27c3c05ccbfe4639ddb078d69/diff:/var/lib/docker/overlay2/a1e01b8adf818195ad7ae88cb858f8e960f8bab508f5ff84631617d80f51f54a/diff:/var/lib/docker/overlay2/dd96876ba88a9de85fdc6192aaacc16697b175f320345395a03012509f77ce84/diff:/var/lib/docker/overlay2/0bea445ceb8a442799ce063ed548de70e87fc850d18927bb2fd6055f1a21c4aa/diff:/var/lib/docker/overlay2/ba6fa2a0ea299109a5339d824a407381a6058c5800723896a142199d12a8aa84/diff:/var/lib/docker/overlay2/bb964bafc3f66feda603b5f6fb0b79e08841d950f43340d08feaf327acba820e/diff:/var/lib/docker/overlay2/edc9a0c253ce0e3d55b71e528cd58a808ea77e69b400bca4f5e80ac15f353f9f/diff:/var/lib/docker/overlay2/e1ecc955c3d6d8560004724edf5138b11211ce548cf1f929ede0200f98a2a8fd/diff:/var/lib/docker/overlay2/bc2988b4b19e54442fbc0b696fabeb0deb12ec7201089216f8c25f3094bb99c2/diff:/var/lib/docker/overlay2/eb2374b53f6ee40ba7ed563624da8ef72090a33434f89a7c8c1628edddea3afc/diff:/var/lib/docker/overlay2/0ca58b7b85e552684b694e0cf4211c16cd1d9a25f838d77ff1c7c54e751f9ffa/diff:/var/lib/docker/overlay2/6735ea88d6e5882c37831eb0159c4c334ea700d82f725c19263cbec5c06b3a0d/diff",
  63.                 "MergedDir": "/var/lib/docker/overlay2/d763c0105649a132c4a5012ffbd138309d69b30614819bee9de0520aa8cbc97d/merged",
  64.                 "UpperDir": "/var/lib/docker/overlay2/d763c0105649a132c4a5012ffbd138309d69b30614819bee9de0520aa8cbc97d/diff",
  65.                 "WorkDir": "/var/lib/docker/overlay2/d763c0105649a132c4a5012ffbd138309d69b30614819bee9de0520aa8cbc97d/work"
  66.             },
  67.             "Name": "overlay2"
  68.         },
  69.         "RootFS": {
  70.             "Type": "layers",
  71.             "Layers": [
  72.                 "sha256:7f5cbd8cc787c8d628630756bcc7240e6c96b876c2882e6fc980a8b60cdfa274",
  73.                 "sha256:31ee2011b35056e3f2d13588f0339c10cc52aa3aa012115a898f3c0f2f2cea12",
  74.                 "sha256:bcb7e1bba665108211179067843fd5669a615985876d714fe6b514623f0646f3",
  75.                 "sha256:edddb68f1107b1ec9749e7179861bb05101d6ab0a25c7fdbaa6bcca3f3efb6a8",
  76.                 "sha256:f4a8f811d64909283c3d034a62854d58038b5ead4ca81daf2d18b77b513cf9ac",
  77.                 "sha256:4159f985d3d7355f776f469f963baf788ec7cc18bd39e19a8fc09957cf16d6de",
  78.                 "sha256:baab2246ac3752fbcf00c15cd2da420fc8d038b1653fb7cffde31f7d73e275f6",
  79.                 "sha256:6d77072e218fa42be7fcfed9042a4ebb0516cd9a620afa7a42d1152dbfcd3c64",
  80.                 "sha256:ae6ff7afaa7dc483977a7ea37297811845d85766e773ccbb7ff9ea423751fac6",
  81.                 "sha256:0c29a5058290dc0c5e25858f381a79ba251086c3673c2b0e18dda3d927bf30da",
  82.                 "sha256:994a8a9b9c739525feca701836f7588a49e3aed2a5d793408137d050514886b5",
  83.                 "sha256:7845320de00b2f6df9fb96449c28144046a57cef7c21deb0fbb0cd67dc1bfa79",
  84.                 "sha256:e2e270c825310889e2ffbf63e6ebc0242922578e7e5e10e4fab8a57bfa14895b",
  85.                 "sha256:5b46e997de5d7a7d5b05b0ede935e4f874865545088470e253bb875db3813742",
  86.                 "sha256:c41cd2ac1809cd8f138292002ed212b71cf2023312ebc145213e6141fcb4aae7",
  87.                 "sha256:00065846e1b2529b7d067f69d337fefae4b21820e867b3a197d4aff7236d4c32",
  88.                 "sha256:2680587e5c138de7774957e9e9e719ca0001bad35de02c1591be076074b95a5a",
  89.                 "sha256:ca2cfc2a18fa0e14e769b4aee50fe9ba029fe9f3804fabb127269fbad23d8ac8",
  90.                 "sha256:56e12d93a1e04d0b3e1a78986d86f75253c672aa77be20361297f4922b3b4434",
  91.                 "sha256:75cb3d09c5cd3d1a2821128bf802b2aa579bbc72d6fe74961ae49e81bdd959c7",
  92.                 "sha256:400db666eabe69b76281b848b87db7141c500e0691e77c040c693f887eac0198",
  93.                 "sha256:fb4cac45996db1f1ffec72300e2440e748b1b7ebf9b58239ea40412848951d11",
  94.                 "sha256:9992e2d43eb43190de69f09e6b1a4c5875da0d98d01a9b511840714916136d22",
  95.                 "sha256:a897631f1d7e1d278bffd5d0779a48a2903cd785066413790ecf4ee35873f08c",
  96.                 "sha256:d2cafa6a4b0dda355ebf2f503ad2adf3b3d1f11914fce9eeb29aca71d392d56d",
  97.                 "sha256:602784cb8372973959b41d03ba7ad594fd570235b0779fbd4f99266fc6e5789b",
  98.                 "sha256:06385292e85518efb48150446b1ef2dbca303e700df1f6d7a4b67ca075ab2475",
  99.                 "sha256:22e0bbb693afb88bf8720ad364b814c9ed636a3f60d5e2073c5670c87e8fc453",
  100.                 "sha256:031c20eee823715dddd5ff30fb62ea5401c00bb32afed64ff438787b0d7c52e9",
  101.                 "sha256:8e3d42b9d0ddda5159762f665a134e4fbcbef2cf212fe30961d3d86b2ec3dab1",
  102.                 "sha256:61a57dacb4c236a9873eab9b9c006255ff36308eeb16a6670721935a101df1bc",
  103.                 "sha256:f37676c18b4d125b2802241d044cc06bf37c26eae25a8a9095004f52abef5424",
  104.                 "sha256:0b23e139435ff5a593a3f4e10cd86b454072b8089a737880d7550bb3a8e40104",
  105.                 "sha256:fc9b1f609aa742d022659866f1139068c37f605412cbf9646c7c780cddb13b8c",
  106.                 "sha256:5f70bf18a086007016e948b04aed3b82103a36bea41755b6cddfaf10ace3c6ef"
  107.             ]
  108.         },
  109.         "Metadata": {
  110.             "LastTagTime": "0001-01-01T00:00:00Z"
  111.         }
  112.     }
  113. ]
+ Expand

Author

Fari Tigar

December 2024