Abstract

This post will summarize the research and cross-checking process we used to build our open-source implementations of Implied Volatility and Greek indicators for LEAN. After validating our implementations with two external sources, we can be confident our implementations are accurate for a wide range of strikes, expiries, and asset volatilities. Notably, we discovered potential issues with another popular open-source implementation and reverse-engineered the implementations of our third-party cross-check vendors. 

Project Goals

To date, we have used the vanilla Black-Scholes-Merton (BSM) model to calculate Implied Volatility (IV) using the QuantLib library. We also observed that BSM's IVs differ from popular Option data vendors, like Interactive Brokers (IB), so we aim to improve our IV modeling.

We started by re-implementing multiple option pricing models in pure C# code, with QuantConnect indicators, to precisely match the QuantLib package. We expect a smooth volatility smile -- a symmetric U-shape parabola of IV against log-moneyness (due to the conditional expectation of log-normal price distribution assumption). To achieve the smooth smile that match third-party sources better, we overlay smoothing functions.

Unlike QuantConnect, third-party sources do not open-source how they calculate IV and Greeks, so we must experiment to get close approximations. Cross-validation is difficult as all the third-party sources we checked have different values. 

5UHABiwUBzZXq-eg1K0vzN4olD9ZrD9CPXsfwefk0bLIbvGx_b1M9HvaQZsE8l2_JmB2kwraigDhHfyKX6lfnXkeYziHs_L15t4aYnWaz4mNqRgmV4dlfpeKj7pjIJVuuXEZyH5t1_On3Dvky1ZIYcc

We aim to produce realistic, accurate IV values, giving you an edge in obtaining the correct hedging size and capitalizing on arbitration opportunities when mispricing happens.

Our Process

Indicator Implementation

Over three months of research, we implemented flexible IV and Greek indicators from scratch. It provides flexibility in calibrating IV with custom objective functions and smoothing functions, which can incorporate the price of the call-put counterpart of the Option contract with the same strike and expiry in calculating a fair IV. This allows various IV smoothing techniques, such as call-put parity under the Law of One Price (BlackScholes.pdf (columbia.edu)), to fit our expectations of a smooth and symmetric IV smile.

def initialize(self):
    strike, expiry = 505, datetime(2014, 6, 27)
    option = Symbol.create_option("AAPL", Market.USA, OptionStyle.AMERICAN, OptionRight.PUT, strike, expiry)
    self.add_option_contract(option)

    mirror_option = Symbol.create_option("AAPL", Market.USA, OptionStyle.AMERICAN, OptionRight.CALL, strike, expiry)
    self.add_option_contract(mirror_option)

    # A call-put counterpart is required for smoothing the IV

We did this without relying on QuantLib for the modeling. This was done to have more control over community-reported bugs in the QuantLib package. Going forward, we will use Lean's new in-built Option indicators to produce IV values.

The ImpliedVolatility indicator constructor takes the following arguments:

Argument Data Type Description Default Value
symbol Symbol The option symbol whose values we want as an indicator
mirror_option Symbol The mirror option contract used for parity type calculation None
risk_free_rate float The risk-free interest rate. If you don't provide a value, the default value is the US primary credit rate from the Interest Rate Provider Model. None
dividend_yield float The dividend yield rate. If you don't provide a value, the default value comes from the Dividend Yield Provider Model. None
option_model OptionPricingModelType The Option pricing model that's used to calculate the Greeks. If you don't provide a value, the default value is OptionPricingModelType.BLACK_SCHOLES for European Options or OptionPricingModelType.BINOMIAL_COX_ROSS_RUBINSTEIN for American Options. None
resolution Resolution The resolution of the indicator data. If you don't provide a value, the default value is the resolution of the subscription you have for the Option contract(s). None

We can customize the smoothing function with the set_smoothing_function method. It takes a callable function that takes in 2 arguments of the modeled IVs using vanilla backpropagation from the selected Option pricing model for both the Option contract and its call-put counterpart and returns a numerical value of the smoothened IV.

# For example, we take the average
self._iv.set_smoothing_function(lambda iv, mirror_iv: (iv + mirror_iv) / 2)

Please refer to the docs here for technical details of the QC Option indicators. [Option Indicators - QuantConnect.com]

 

Cross Validation Summary

We tested our ImpliedVolatility indicator against three different third-party sources. In each case, we obtained thousands of data points with different Option rights, Option styles, strike prices, Option market prices, underlying prices, and time until expiration. 

We experimented with initializing our ImpliedVolatility indicator with various Option models and smoothing functions to find the best match (by lowest mean-squared error, MSE) to the reference vendor data source. The table below has summarized the final results:

Vendor Option Style Option Model Smoothing Function
QuantLib European/American BSM /
Interactive Brokers (IB) American Binomial Forward-Tree Use OTM contract's IV only
Third-Party Vendor American Binomial Forward-Tree Use OTM contract's IV only

We calculated the error at every strike to understand the accuracy of our new indicators compared to third-party sources. We formed a distribution of the errors grouped into  1%, 5%, and 10% buckets. If a sample point had a 4% error, it was included in the "Within 5%" and “Within 10%" buckets but not the "Within 1%" one.

Cross-validation with QuantLib

Case Samples within the error margin
1% 5% 10%
QuantLib 100% 100% 100%

With our bespoke implementation, we could perfectly replicate the IV values from QuantLib. It applied a plain BSM model for calculating IV and was easily reproduced. Although this did not help our project goals, it provided a benchmark for our indicator's reliability and accuracy. The image below plots the IV of QuantConnect and QuantLib on the SPY Option (Exp: 9 Feb 2024) from 7 Feb 2024.

# Parameters to match QuantLib IV Curve.
iv = self.iv(contract_symbol, risk_free_rate=None, dividend_yield=None, option_model=OptionPricingModelType.BLACK_SCHOLES)
E3DsYd3SEwM1-944KwV1PyxujKRoWbESvS3j-Jbk711XgI9kZJO5G4W5QijuVWVz42awxFjQP5A530Istdy9-DGtqZZA41_YfV8ltx5e1cOx2_SDZIEP6ZCla1PCKtLBJG_FriMZyLQkPwOOBXf09dQ

Cross-validation with Interactive Brokers

As a popular broker, IB is also a popular source of Option IV and Greek data. We obtained IB's IVs by caching real-time IV and Greek quotes during trading hours and tried to reproduce IB's figures by reverse-engineering. We observed the following points:

  1. Contracts with the same strike price, expiry, and underlying asset had the same IVs for call-and-put contracts.
  2. When plotting the IB IV they had a smooth and symmetric IV smile.

The Interactive Brokers IV values seemed to be a good goal given the textbook-like smoothness of their curve. We reached out to IB to ask for more information on their model, but they only provided a broad explanation resembling their website without too many details:

  1. The BSM model for European Options, and a 100-step Binomial model for American Options.
  2. The Eurodollar contract's spot rate to calculate the interest rate.
  3. A 1-year lookback of dividend payments to calculate the dividend yield.

Although the exact methodology remains proprietary, we can narrow down the parameters they were using and approximate them through trial and error (with MSE as the criterion). We tried all combinations with the below choices on different parameters, and obtained the best-fitted combination in bold:

Option Model (Binomial) Smoothing Function Interest Rate Dividend Yield
Cox-Ross-RubinsteinCall-put parity objective functionPlain Eurodollar spot rate1-year total payoff
Forward TreeUsing the average of call-put pairContinuous Eurodollar rate by ln(1+r)Discounted 1-year total payoff
Jarrow-RuddUsing the minimum of call-put pairContinuous 1-year total payoff by ln(1+r)
Leisen-ReimerUsing the maximum of call-put pair
Using call options only
Using put options only
Using ITM options only
Using OTM options only

After updating the IV indicator with the preceding parameters, the errors lie mostly about 4-6%. This result holds for any contract, strike range, and expiries. Thus, it is reasonable to think that the Option pricing model and IV smoothing function are very close to what IB adapted while suspecting an unmatched hyperparameter or a missing term on the pricing model.

The below image shows an example of IV cross-matching of our indicator values versus IB's values, on the SPY Option (expiring on 9 Feb 2024) data from 7 Feb 2024.

# Parameters to match Interactive Brokers IV curve.
iv = self.iv(call_contract_symbol, mirror_option=put_contract_symbol, risk_free_rate=None, dividend_yield=None, option_model=OptionPricingModelType.FORWARD_TREE)
JGHucHpoXakn5VOTsBbrAULanfPN0pvAkBXwfAi6wB7Jg3JJHyyj1_9XfyCh3ZfiPQUV3xQaPPpll-eHs4Kb36v85CQdxC47GM9WsY-Ub7ii87KrcsXFhmu1GoJCnnxepVMXlzRNi-ljJ2CcDq4zT1s

Cross-validation with Third Party

We chose another popular third-party source for comparison. We do not know much about the third source's methodology but only know that they use a modified binomial model, and a custom dividend yield model involving put-call parity. We tried a similar approach of trial and error to determine the best parameters. We were able to obtain a close match on ATM and ITM contracts, but not the OTM ones. Let's explain with an example of the same case.

kkugRuIXnaPjgjSKQCq0Y_qR4eaoUIrcrZfs-49C-OYDoX3QSKwUQ2sES_VGxh1q3HSe2NAKiFv9v-bBxKglFF-ChPaFjMVU8Y3FeN4sW9SgTBodY39EQG_c8njAU-6XI03SGTaRVm951wBojg56-A0
TgNI3Lh7HXrM1NQfoX7S97XsRBUCxKKcN10u3Mk0PHMgHtkiCfwtRYef607jUBq74UBg12tK5rSp_QwhKqgLt1hXEiIVHh4f0k9vrUh5mf3u6Tk9ysbmcqhLREW8cCf2kZLoU9nLouBsE7W37uJUGJo

The images show a near-perfect match for ATM/ITM calls and ATM/ITM puts, so we are confident that IVs of ATM and ITM Options are calculated this way, but not OTM Options. From the curves, we can observe a sudden jump (at around $ 507 strike calls and $ 480 strike puts) in the curve. Since the jump happened only 1-2 times, and affected the subsequent strikes, this suggests the vendor might fit the whole IV surface at once, with an underlying process involving a stochastic Levy jump process, or mixture distribution of the underlying price series, so that the probability expectation of the future price is discontinuous at some price levels. This violates our goal of a smooth IV smile. Generally, we seek a smooth curve to reduce arbitrage opportunities which can be exploited with jumps. The Heston stochastic pricing model is typically the gold standard and results in smooth IV curves. 

Results

The table below summarizes the results of matching third-party source IVs with Lean's ImpliedVolatility indicator, from the discussions in previous sections. 

For example, an accuracy of 75% under the column 5% means 3 out of 4 IV values would be within 5% error (i.e. IV of 1.0 recorded from reference, and 0.95-1.05 calculated by our indicator). 

Full Range of Strikes Accuracy ATM +/-5 strikes Accuracy All ITM Accuracy All OTM
1%5%10% 1%5%10% 1%5%10%
QuantLib 100%100%100% 100%100%100% 100%100%100%
IB 25%75%100% 0%13%100% 0%13%100%
Third-Party Vendor 91%99%100% 17%44%57% 75%96%100%

Conclusion

Option pricing is both science and art. It is crucial to understand how an Option is priced and the rationale behind IV, from risk management through hedging to speculation or arbitration traders. 

One advantage of mirror Option implied volatility smoothing is its ability to reduce noise and fluctuations in volatility estimates. By applying mathematical algorithms or statistical methods, mirror Option implied volatility smoothing can provide a more stable and reliable estimate of implied volatility. This can be particularly useful when the underlying asset exhibits high volatility or when limited data points are available. However, it could be computationally intensive without analytical or numerical solutions to directly deduce the IV. It is also subjective and sensitive to the pricing model choice and smoothing function. 

Lean’s new ImpliedVolatility indicator allows high flexibility on the choice of Option pricing model and the smoothing process for calculating IV, providing a sharp tool for conquering the quest for a true, fair Option price.