A Deep Dive Into Venn’s Desmoothing and Interpolation Features for Private Assets

Product Information

Public and private markets are driven by common economic drivers such as economic growth, interest rates, commodities, and credit, which are captured by Venn's Two Sigma Factor Lens. When the global economy slows, liquid assets such as public equity, and illiquid assets such as private equity, should fall together. However, reported private manager returns often provide a different and unintuitive outcome.

In public markets, investors typically utilize performance that is marked-to-market, in real-time, and daily. On the other hand, private market performance is typically smoothed, marked-to-value, lagged relative to public markets, and infrequent. Smoothed private asset returns may also artificially lower volatility and reduce the explainability of risk, the latter being an important and often overlooked consequence of smoothing. For investors looking to holistically analyze a portfolio that includes private assets, especially alongside public market investments, this data limitation poses a significant hurdle. 

Take a classic private real estate example such as the NCREIF Property index and a public proxy.1 Focusing on the 2009 rebound, we see how private real estate began an upward movement multiple quarters after that of the public proxy. This is despite the notion that they are probably driven by the same movements in common risk factors, such as economic growth and interest rates. 


Exhibit 1: Smoothed Private Real Estate Has Lagged Public Markets

Source: Venn by Two Sigma, Bloomberg. Period from Q4 1997 to Q3 2022. The NCREIF Property index represents private real estate while the MSCI US REIT index represents the public proxy.


Additionally, over this period the private real estate index exhibited a volatility of just 4.42% while the public proxy’s volatility was 21.13%. Understanding that these differences are not likely real, but rather the outcome of smoothed and infrequent private data, promotes a call to action. 


How to View Private Asset Data Through a Public Lens 

Public market data is frequent and marked to market. As a result, one way to potentially improve the quality of private asset returns is by making them look and feel more like a public market proxy. To accomplish this goal, Venn uses two statistical methods: desmoothing and interpolation. 

Below you can see the role that each method plays on the journey to viewing private asset returns with a public lens. Specifically, desmoothing aims to reduce private market performance lag and mark it to the market, while interpolation aims to increase the frequency of data. 


Exhibit 2: Utilizing Desmoothing and Interpolation to Take a Public View

Source: Venn by Two Sigma. For illustration purposes only.


More About Desmoothing

A primary goal of desmoothing is to account for the lag that is typically exhibited between private and public markets. One reason for this lag is that private managers, who are marking their assets to valuation rather than market transactions, typically reveal those asset valuations on a delayed basis.

When we desmooth private asset returns, we follow the econometric model by Getmansky, Lo, and Marakov (2004). Put simply, we attempt to reverse-engineer the smoothing process by looking at smoothed private asset performance and its regression- based relationship with an appropriate public proxy. 

We will review three steps we believe to best summarize this process:

  1. Estimating the relationship of reported returns with public proxy returns
  2. Choosing the number of lags to model
  3. Reversing the smoothing process


Estimating the Relationship of Reported Returns with Public Proxy Returns

Because a well-chosen public proxy should theoretically be exposed to similar risk factors as the private asset, the public proxy can be used to provide information about how the private asset was smoothed.

To model the relationship between the private asset return and a chosen public proxy, we run multiple regressions using different lagged public proxy return streams. This means running regressions between the private asset return and a public proxy return stream that has been shifted based on the frequency of the private asset (quarterly lags, for example). We do this because the private asset should have exposure to both present and past versions of the public proxy, depending on the smoothing profile of the private asset.

In our example below, we show how different betas (slope) reveal exposure to the public proxy for each lag (more on how to decide on the number of lags later). We then aggregate these betas to represent the true economic exposure. We then scale these results with the aggregated exposure to imply that the information is contained within the selected number of lags. Quantifying this relationship will play a key role in reversing the smoothing process later on.


Exhibit 3: Estimation Strategy for Private Asset Returns and a Public Proxy

Source: Venn by Two Sigma. For illustrative purposes only.


Choosing the Number of Lags to Model

When estimating the relationship of reported returns with public proxy returns such as those shown in Exhibit 3, the number of lags being used is important. In some cases the investor may know the number of lags that a manager implements when smoothing their returns. In such cases, it will always be best to use the true number of lags as an input to the desmoothing process. 

In cases where the number of lags is not known, a statistical process known as Akaike Information Criterion (AIC) can be used. AIC will evaluate multiple models with different numbers of lags, and then select the one of the highest quality. But how many models with different lags should we evaluate? What is the maximum number of lags we will allow?

When choosing the number of lags to model through AIC, we assume two things:

  1. The information will not lag more than 1 year. In the case of quarterly data, we believe there can be more delay, so we allow two extra quarters to search for lags. Therefore for monthly data: lags ≤ 12 and for quarterly data: lags ≤ 6.

  2. There need to be at least 12 observations in the regressions being tested, after considering the number of lags.


Reversing the Smoothing Process

We view each theta (Θ), as discussed in Exhibit 3, as weights in a moving-average model. This means that multiplying each past true return by the corresponding theta should sum to equal the reported return. 

Put another way, Θn determines the percent contribution that each past true return plays in the smoothing process to arrive at the reported return to investors. In Exhibit 4 we illustrate this relationship. 


Exhibit 4: Modeling Smoothing Using a Moving Average Process

Source: Venn by Two Sigma. For illustrative purposes only.


Modeling this relationship helps to reverse engineer, or “invert” the smoothing profile and uncover what we believe are the true economic returns.2


What are some measures of success for a desmoothed return stream?

  1. An increase in volatility: Desmoothing returns may increase volatility by adjusting them to more accurately reflect public market volatility.

  2. A decrease in autocorrelation: High autocorrelation is a natural bias of smoothing. Decreasing the absolute magnitude of autocorrelation better reflects market reactions (by moving it closer to the autocorrelation of the public proxy) and indicates that past returns are now less similar to future returns.

  3. A decrease in residual contribution to risk: Venn’s Two Sigma Factor Lens is holistic, aiming to explain a large degree of portfolio variation. Smoothed private asset returns represent an unnatural market process that leads to larger amounts of unexplainable risk (residual). Desmoothing may reduce this unexplainable risk. 

Given these three measures of potential success, we tested Venn’s desmoothing process on private real estate, equity, buyouts, and venture capital, and summarized our results below in Exhibit 5. In every instance, changes in all three measures met our expectations with volatility increasing, and autocorrelation and residual risk contribution decreasing. 


Exhibit 5: Results From Desmoothing Various Private Asset Indexes

Source: Venn by Two Sigma, Bloomberg. Real Estate analysis from Dec 1997–Sep 2022. All other analysis from March 2001–March 2022. Public proxies are based on Preqin’s Public Market Equivalent “Pro Tips” and are as follows: Real Estate: MSCI US REIT index (4 lags used). Private Equity: S&P 500 index (4 lags used). PE Buyout: Russell 3000 index (4 lags used). PE Venture Capital: Russell 2000 index (5 lags used).  


Using our example from Exhibit 1, below we show the output of our desmoothing feature on the private real estate time series. Notice how the orange line now rebounds at the same time as the public proxy in 2009.  


Exhibit 6: Results from Desmoothing on Private Real Estate

Source: Venn by Two Sigma, Bloomberg. Period from Q4 1997 to Q3 2022. 4 lags used for desmoothing.


More About Interpolation

Despite the illustrated success of our desmoothing results, increasing the frequency of private asset returns is a separate task. Especially when considering consistency across data sets, it can be useful for allocators to convert their quarterly private assets returns into daily. 

When interpolating, Venn: 

  • Adds a constant daily return to the chosen public proxy, such that taking the cumulative return should closely match the private asset’s return. Venn then uses that new daily return stream for the private asset. Below we provide an illustrative example of interpolation over a one week period. 


Exhibit 7: Illustrative Example of Interpolation Over One Week

Source: Venn by Two Sigma. For illustration purposes only.


Our expectation is that the resulting, now-daily return series will approximate that of the original private asset’s return, but with a volatility that roughly matches the chosen public proxy. 

In Exhibit 8 we show the output of both desmoothing and interpolation on private real estate. Notice how this once smoothed quarterly time series now experiences market timing in-line with the public proxy from desmoothing, along with daily volatility incorporated from interpolation.


Exhibit 8: Results from Desmoothing and Interpolation on Private Real Estate

Source: Venn by Two Sigma, Bloomberg. Period from 10/3/1997 to 9/30/2022. 4 lags used for desmoothing


(De)Smoother Sailing When It Comes to Private Asset Returns

Using Venn’s desmoothing technique on private asset returns, we revealed higher volatility while decreasing autocorrelation and residual risk contribution. Additionally, using interpolation, we were able to transform infrequent data into daily data. 

Given that our clients continue to leverage Venn for multi-asset portfolio analytics, we are pleased they can use these features to view private assets with a familiar public lens. This may allow investors to better understand levels, timing and drivers of risk, but also may improve operational logistics when working with other daily holdings in the context of a multi-asset portfolio. When looking to conduct portfolio analytics that include private asset returns, we believe these two steps make for smoother sailing via a unified public lens.




1Getmansky, Mila, Andrew W. Lo, and Igor Makarov. "An econometric model of serial correlation and illiquidity in hedge fund returns." Journal of Financial Economics 74.3 (2004): 529-609.

2Hamilton, James Douglas (1994). Time Series Analysis. Princeton University Press. ISBN 0-691-04289-6.


Disclaimer: Proxies are for estimation purposes only and have many inherent limitations. The methodology for calculating potential proxies was chosen in our professional judgment, and will not always yield the most accurate available proxy. Our potential proxy suggestions are not a recommendation as to any portfolio, allocation, strategy, or investment nor an offer to purchase or sell any security. We suggest users do their own research to use the public proxy that best fits their own use case.

Exposure to risk factors is not a guarantee of increased performance or decreased risk. Past performance does not guarantee future results. This document presentation is for informational purposes only.  Click here for Important Disclosure and Disclaimer Information.



The information contained in this article is provided for general informational and educational purposes only, and should not be construed as investment advice. The contributor to this material is associated with a client of Two Sigma Investor Solutions, LP (“TSIS”). Neither TSIS nor its affiliates have compensated the contributor for his statements. The statements from the interview have been edited and reformatted by TSIS with the contributor’s approval. Unless otherwise noted, the contributor’s statements do not represent the actual views or opinions of TSIS or its affiliates, or any officers, directors, or employees thereof.

This article is not an endorsement by Two Sigma Investor Solutions, LP or any of its affiliates (collectively, “Two Sigma”) of the topics discussed. The views expressed above reflect those of the authors and are not necessarily the views of Two Sigma. This article (i) is only for informational and educational purposes, (ii) is not intended to provide, and should not be relied upon, for investment, accounting, legal or tax advice, and (iii) is not a recommendation as to any portfolio, allocation, strategy or investment. This article is not an offer to sell or the solicitation of an offer to buy any securities or other instruments. This article is current as of the date of issuance (or any earlier date as referenced herein) and is subject to change without notice. The analytics or other services available on Venn change frequently and the content of this article should be expected to become outdated and less accurate over time. Any statements regarding planned or future development efforts for our existing or new products or services are not intended to be a promise or guarantee of future availability of products, services, or features.  Such statements merely reflect our current plans.  They are not intended to indicate when or how particular features will be offered or at what price.  These planned or future development efforts may change without notice. Two Sigma has no obligation to update the article nor does Two Sigma make any express or implied warranties or representations as to its completeness or accuracy. This material uses some trademarks owned by entities other than Two Sigma purely for identification and comment as fair nominative use. That use does not imply any association with or endorsement of the other company by Two Sigma, or vice versa. See the end of the document for other important disclaimers and disclosures. Click here for other important disclaimers and disclosures.

This article may include discussion of investing in virtual currencies. You should be aware that virtual currencies can have unique characteristics from other securities, securities transactions and financial transactions. Virtual currencies prices may be volatile, they may be difficult to price and their liquidity may be dispersed. Virtual currencies may be subject to certain cybersecurity and technology risks. Various intermediaries in the virtual currency markets may be unregulated, and the general regulatory landscape for virtual currencies is uncertain. The identity of virtual currency market participants may be opaque, which may increase the risk of market manipulation and fraud. Fees involved in trading virtual currencies may vary.

Ready to Talk?

Contact us to set up an initial conversation about Venn