Testing equivalence with TOST in XLSTAT

Dataset for Equivalence test (TOST) XLS29.0 KB

Tutorial video
Equivalence test (TOST) is part of: Download Trial version More details See users' feedback

  • Pro Core statistical software

  • System configuration

    • Windows:
      • Versions: 9x/Me/NT/2000/XP/Vista/Win 7
      • Excel: 97 and later
      • Processor: 32 or 64 bits
      • Hard disk: 150 Mb
    • Mac OS X:
      • OS: OS X
      • Excel: X, 2004 and 2011
      • Hard disk: 150Mb.

Benefits

  • Easy and user-friendly
    Easy and user-friendly XLSTAT is flawlessly integrated with Microsoft Excel which is the most popular spreadsheet worldwide. This integration makes it one of the simplest available tools to work with as it utilizes the same philosophy as Microsoft Excel. The program is accessible in a dedicated XLSTAT tab. The analyses are grouped into functional menus. The dialog boxes are user-friendly and setting up an analysis is straightforward.
  • Data and results shared seamlessly
    Data and results shared seamlessly One of the greatest advantages of XLSTAT is the way you can share data and results seamlessly. As the results are stored in Microsoft Excel, anyone can access them. There is no need for the receiver to have an XLSTAT license or any additional viewer which makes your team-work easier and more affordable. In addition, results are easily integrable into other Microsoft Office software such as PowerPoint, so that you can create striking presentation in minutes.
  • Modular
    Modular XLSTAT is a modular product. XLSTAT-Pro is a core statistical module of XLSTAT which includes all the mainstream functionalities in statistics and multivariate analysis. More advanced features contained in add-on modules can be added for specific applications. This way you can adapt the software to your needs making the software more cost-efficient.
  • Didactic
    Didactic The results of XLSTAT are organized by analysis and are easy to navigate. Moreover useful information is provided along with the results to assist you in your interpretation.
  • Affordable
    Affordable XLSTAT is a complete and modular analytical solution that can suit any analytical business needs. It is very reasonably priced so that the return of your investment is almost immediate. Any XLSTAT license comes with top level support and assistance.
  • Accessible - Available in many languages
    Accessible - Available in many languages We have ensured XLSTAT is accessible to everyone by making the program available in many languages, including Chinese, English, French, German, Italian, Japanese, Polish, Portuguese and Spanish.
  • Automatable and customizable
    Automatable and customizable Most of the statistical functions available in XLSTAT can be called directly from the Visual Basic window of Microsoft Excel. They can be modified and integrated to more code to fit to the specificity of your domain. Adding tables and plots as well as modifying existing outputs becomes easy. Furthermore, XLSTAT includes some special tools on the dialog boxes to generate automatically the VBA code in order to reproduce your analysis using the VBA editor or to simply load pre-set settings. This effortless automation of routine analysis will be a huge time saver on your part.

Principle of the TOST equivalence test

XLSTAT equivalence test allows to test if two products are equivalent. TOST means two-one-sided-test.

This type of test is used primarily to validate bioequivalence. When we want to show the equivalence of two drugs, classical hypothesis testing does not apply, we will use equivalence testing which will validate the equivalence between the two drugs.

XLSTAT offers two equivalent methods to test equivalence using the TOST test.

  • Using the 100 * (1-2 * alpha)% confidence interval around the mean. By comparing this interval to the user-defined interval of equivalence, we can conclude the equivalence or non equivalence. Thus, if the confidence interval is within the interval defined by the user, we conclude the equivalence between the two samples. If one of the bounds of the confidence interval is outside the interval defined by the user, then the two samples are not equivalent.
  • Using two one-sided tests, one on the right and one on the left. We apply a right one-sided t-test on the lower bound of the interval defined by the user and a left one-sided t-test on the upper bound of the interval defined by the user. We obtain p-values for both tests. We take the greatest of these p-values as p-value of the equivalence test.

Dataset to run a TOST equivalence test on two independent samples

An Excel sheet containing both the data and the results for use in this tutorial can be downloaded by clicking here.

The data represent the time that a customer will spend in a restaurant depending on the type of wine that is offered (red or white). The restaurant owner want to have his customer stay longer so that they spend more money in his establishment. There are 42 customers that have been studied.

We want to know if the fact that a customer chooses red or white wine is equivalent regarding the time spent in the restaurant. The difference should not exceed 10 minutes, we choose to have a TOST interval of [-10; 10].

Setting up a TOST equivalence test

After opening XLSTAT, select the XLSTAT / Parametric tests / TOST (Equivalence test) command, or click on the corresponding button of the Parametric tests toolbar (see below).

menu tost

Once you've clicked on the button, the dialog box appears.

We select one column in each box.

dialog box general tost

In the Options tab, we want to test a difference of 0 and the bounds of the equivalence test are -10 and 10.

dialog box options tost

The computations begin once you have clicked on OK. The results will then be displayed in a new sheet.

Interpreting the results of an equivalence (TOST) test on two independent samples

The first results displayed are the statistics for the various samples. Next, the equivalence test is displayed. There are two equivalent results to interpret the TOST.

The first table displays the 90% confidence interval of the mean and compares it to the user defined TOST interval.

result tost test 1

In order to have equivalence between red and white wine, the 90% confidence interval has to be included in the TOST interval. We can see that -16,140<-10, so the equivalence is not accepted.

The second table is equivalent to the first one, but using one-sided t-test with associated p-values.

results tost test 2

We see that with a total p-value of 0.219, the equivalence is rejected.

We can conclude that offering white or red wine is not equivalent regarding the time spent in the restaurant by the customers.