Quiver Quantitative

Wikipedia Page Views

Introduction

The Wikipedia Page Views dataset by Quiver Quantitative tracks Wikipedia page views for US Equities. The data covers 1,300 US Equities, starts in October 2016, and is delivered on a daily frequency. This dataset is created by scraping the Wikipedia pages of companies.

This dataset depends on the US Equity Security Master dataset because the US Equity Security Master dataset contains information on splits, dividends, and symbol changes.

For more information about the Wikipedia Page Views dataset, including CLI commands and pricing, see the dataset listing.

About the Provider

Quiver Quantitative was founded by two college students in February 2020 with the goal of bridging the information gap between Wall Street and non-professional investors. Quiver allows retail investors to tap into the power of big data and have access to actionable, easy to interpret data that hasn’t already been dissected by Wall Street.

Getting Started

The following snippet demonstrates how to request data from the Wikipedia Page Views dataset:

self.aapl = self.add_equity("AAPL", Resolution.DAILY).symbol
self.dataset_symbol = self.add_data(QuiverWikipedia, self.aapl).symbol

self._universe = self.add_universe(QuiverWikipediaUniverse, , self.universe_selection)

_symbol = AddEquity("AAPL", Resolution.Daily).Symbol;
_datasetSymbol = AddData<QuiverWikipedia>(_symbol).Symbol;

_universe = AddUniverse<QuiverWikipediaUniverse>(UniverseSelection);

Data Summary

The following table describes the dataset properties:

PropertyValue
Start DateOctober 2016
Asset Coverage1,300 US Equities
Data DensitySparse
ResolutionDaily
TimezoneUTC

Example Applications

The Wikipedia Page Views dataset enables you to observe patterns in the traffic of company Wikipedia pages. Examples include the following strategies:

  • Capitalizing on companies that have experienced a sharp increase in Wikipedia traffic on the premise that volatility in traffic will translate to volatility in price
  • Mitigating risk by avoiding companies that have a decreasing web presence on the premise that a reduction in traffic will result in a reduction in price

For more example algorithms, see Examples.

Data Point Attributes

The Wikipedia Page Views dataset provides QuiverWikipedia and QuiverWikipediaUniverse objects.

QuiverWikipedia Attributes

QuiverWikipedia objects have the following attributes:

QuiverWikipediaUniverse Attributes

QuiverWikipediaUniverse objects have the following attributes:

Requesting Data

To add Wikipedia Page Views data to your algorithm, call the AddDataadd_data method. Save a reference to the dataset Symbol so you can access the data later in your algorithm.

class QuiverWikipediaPageViewsDataAlgorithm(QCAlgorithm):
    def initialize(self) -> None:
        self.set_start_date(2019, 1, 1)
        self.set_end_date(2020, 6, 1)
        self.set_cash(100000)

        symbol = self.add_equity("AAPL", Resolution.DAILY).symbol
        self.dataset_symbol = self.add_data(QuiverWikipedia, symbol).symbol
namespace QuantConnect
{
    public class QuiverWikipediaPageViewsDataAlgorithm : QCAlgorithm
    {
        private Symbol _datasetSymbol;

        public override void Initialize()
        {
            SetStartDate(2019, 1, 1);
            SetEndDate(2020, 6, 1);
            SetCash(100000);
            var symbol = AddEquity("AAPL", Resolution.Daily).Symbol;
            _datasetSymbol = AddData<QuiverWikipedia>(symbol).Symbol;
        }
    }
}

Accessing Data

To get the current Wikipedia Page Views data, index the current Slice with the dataset Symbol. Slice objects deliver unique events to your algorithm as they happen, but the Slice may not contain data for your dataset at every time step. To avoid issues, check if the Slice contains the data you want before you index it.

def on_data(self, slice: Slice) -> None:
    if slice.contains_key(self.dataset_symbol):
        data_points = slice[self.dataset_symbol]
        for data_point in data_points:
            self.log(f"{self.dataset_symbol} weekly page views percentage change at {slice.time}: {data_point.week_percent_change}")
public override void OnData(Slice slice)
{
    if (slice.ContainsKey(_datasetSymbol))
    {
        var dataPoints = slice[_datasetSymbol];
        foreach (var dataPoint in dataPoints)
        {
            Log($"{_datasetSymbol} weekly page views percentage change at {slice.Time}: {dataPoint.WeekPercentChange}");
        }
    }
}

To iterate through all of the dataset objects in the current Slice, call the Getget method.

def on_data(self, slice: Slice) -> None:
    data_points = slice.get(QuiverWikipedia)
    for data_point in data_points.values:
        self.log(f"{dataset_symbol} weekly page views percentage change at {slice.time}: {data_point.week_percent_change}")

public override void OnData(Slice slice)
{
    foreach (var kvp in slice.Get<QuiverWikipedia>())
    {
        var datasetSymbol = kvp.Key;
        var dataPoints = kvp.Value;
        foreach (var dataPoint in dataPoints)
        {
            Log($"{datasetSymbol} weekly page views percentage change at {slice.Time}: {dataPoint.WeekPercentChange}");
        }
    }
}

Historical Data

To get historical Wikipedia Page Views data, call the Historyhistory method with the dataset Symbol. If there is no data in the period you request, the history result is empty.

# DataFrame
history_df = self.history(self.dataset_symbol, 100, Resolution.DAILY)

# Dataset objects
history_bars = self.history[QuiverWikipedia](self.dataset_symbol, 100, Resolution.DAILY)
var history = History<QuiverWikipedia>(_datasetSymbol, 100, Resolution.Daily);

For more information about historical data, see History Requests.

Universe Selection

To select a dynamic universe of US Equities based on Wikipedia Page Views data, call the AddUniverseadd_universe method with the QuiverWikipediaUniverse class and a selection function.

def initialize(self) -> None:
    self._universe = self.add_universe(QuiverWikipediaUniverse, self.universe_selection)

def universe_selection(self, alt_coarse: List[QuiverWikipediaUniverse]) -> List[Symbol]:
    return [d.symbol for d in alt_coarse \
                if d.page_views > 100 \
                and d.week_percent_change < 0.2]
private Universe _universe;
public override void Initialize()
{
    _universe = AddUniverse<QuiverWikipediaUniverse>(altCoarse =>
    {
        return from d in altCoarse
                where d.PageViews > 100m && d.MonthPercentChange > 0.2m
                select d.Symbol;
    });
}

For more information about dynamic universes, see Universes.

Universe History

You can get historical universe data in an algorithm and in the Research Environment.

Historical Universe Data in Algorithms

To get historical universe data in an algorithm, call the Historyhistory method with the Universe object and the lookback period. If there is no data in the period you request, the history result is empty.

var universeHistory = History(_universe, 30, Resolution.Daily);
foreach (var bets in universeHistory)
{
    foreach (QuiverWallStreetBetsUniverse bet in bets)
    {
        Log($"{bet.Symbol} rank at {bet.EndTime}: {bet.Rank}");
    }
}
universe_history = self.history(self._universe, 30, Resolution.DAILY)
for (univere_symbol, time), bets in universe_history.items():
    for bet in bets:
        self.log(f"{bet.symbol} rank at {bet.end_time}: {bet.rank}")

Historical Universe Data in Research

To get historical universe data in research, call the UniverseHistoryuniverse_history method with the Universe object, a start date, and an end date. This method returns the filtered universe. If there is no data in the period you request, the history result is empty.

var universeHistory = qb.UniverseHistory(universe, qb.Time.AddDays(-30), qb.Time);
foreach (var bets in universeHistory)
{
    foreach (QuiverWallStreetBetsUniverse bet in bets)
    {
        Console.WriteLine($"{bet.Symbol} rank at {bet.EndTime}: {bet.Rank}");
    }
}
universe_history = qb.universe_history(universe, qb.time-timedelta(30), qb.time)
for (univere_symbol, time), bets in universe_history.items():
    for bet in bets:
        print(f"{bet.symbol} rank at {bet.end_time}: {bet.rank}")

You can call the Historyhistory method in Research.

Remove Subscriptions

To remove a subscription, call the RemoveSecurityremove_security method.

self.remove_security(self.dataset_symbol)
RemoveSecurity(_datasetSymbol);

If you subscribe to Wikipedia Page Views data for assets in a dynamic universe, remove the dataset subscription when the asset leaves your universe. To view a common design pattern, see Track Security Changes.

Example Applications

The Wikipedia Page Views dataset enables you to observe patterns in the traffic of company Wikipedia pages. Examples include the following strategies:

  • Capitalizing on companies that have experienced a sharp increase in Wikipedia traffic on the premise that volatility in traffic will translate to volatility in price
  • Mitigating risk by avoiding companies that have a decreasing web presence on the premise that a reduction in traffic will result in a reduction in price

For more example algorithms, see Examples.

You can also see our Videos. You can also get in touch with us via Discord.

Did you find this page helpful?

Contribute to the documentation: