Inspect Cached Datasets in Redis for Errors

Tool for inspecting cached pricing data to find common errors. This tool uses the Extraction API to look for dates that are not in sync with the redis cached date.


This tool requires redis to be running with fetched datasets already stored in supported keys


Inspect Minute Datasets for a Ticker -t SPY

Inspect Daily Datasets for a Ticker -t AAPL -g daily
# or
# -t AAPL -g day

Usage -h
usage: [-h] [-t TICKER] [-g DATASETS] [-s START_DATE]

Inspect datasets looking for dates in redis that look incorrect

optional arguments:
-h, --help     show this help message and exit
-t TICKER      ticker
-g DATASETS    optional - datasets: minute or min = examine IEX Cloud
                intraday minute data, daily or day = examine IEX Cloud
                data, quote = examine IEX Cloud quotes data, stats =
                IEX Cloud key stats data, peers = examine IEX Cloud
                data, news = examine IEX Cloud news data, fin = examine
                Cloud financials data, earn = examine IEX Cloud earnings
                data, div = examine IEX Cloud dividendsdata, comp =
                IEX Cloud company data, calls = examine Tradier calls
                puts = examine Tradier puts data, and comma delimited is
                supported as well
-s START_DATE  start date format YYYY-MM-DD (default is 2019-01-01)
analysis_engine.scripts.inspect_datasets.inspect_datasets(ticker=None, start_date=None, datasets=None)[source]

Loop over all cached data in redis by going sequentially per date and examine the latest date value in the cache to check if it matches the redis key’s date.

For IEX Cloud minute data errors, running this function will print out commands to fix any issues (if possible):

fetch -t TICKER -g iex_min -F DATE_TO_FIX
  • ticker – optional - string ticker
  • start_date – optional - datetime start date for the loop (default is 2019-01-01)
  • datasets – optional - list of strings to extract specific, supported datasets (default is ['minute'])