The Strategy Tester allows you to test and optimize trading strategies (Expert Advisors) before using them for live trading. During testing, an Expert Advisor with initial parameters is once run on history data. During optimization, a trading strategy is run several times with different sets of parameters which allows selecting the most appropriate combination thereof.
The Strategy Tester is a multi-currency tool for testing and optimizing strategies trading multiple financial instruments. The tester automatically processes information of all symbols that are used in the trading strategy, so you do not need to manually specify the list of symbols for testing/optimization.
The Strategy Tester is multi-threaded, thus allowing to use all available computer resources. Testing and optimization are carried out using special computing agents that are installed as services on the user's computer. Agents work independently and allow parallel processing of optimization passes.
An unlimited number of remote agents can be connected to the Strategy Tester. In addition, the Strategy Tester can access the MQL5 Cloud Network. It brings together thousands of agents around the world, and this computational power is available to any user of the trading platform.
In addition to Expert Advisor testing and optimization, you can use the Strategy Tester to test the operation of custom indicators in the visual mode. This feature allows to easily test the operation of demo versions of indicators downloaded from the Market.
Optimization means multiple runs of an Expert Advisor using history data with different sets of parameters, aimed at finding their best combination. During multiple runs, different combinations of the input parameters of an Expert Advisor are tested to find the best ones.
Watch the video: How to test Expert Advisors and Indicators before purchase Watch the video to learn how to test a trading robot before you purchase it from the Market. Every product on the Market is provided with a free demo version, which can be tested in the Strategy Tester. Please watch the video for further details. |
After tester launch, instead of multiple settings the user sees a list of standard tasks, by selecting which they can quickly start testing. This will be especially useful for users without previous experience.
Some of the major strategy testing and optimization tasks are presented in the start page. In addition, one of the previously performed tasks can be restarted from this page. If you have run a lot of tasks and they do not fit into the start page, use the search bar. You can find a test by any parameter: program name, symbol, timeframe, modeling mode, etc.
After selecting a task, the user proceeds to further testing parameters setup: selection of an Expert Advisor, symbol, testing period, etc. All irrelevant parameters which are not required for the selected tasks are hidden from the setup page. For example, if mathematical calculations are selected, only two parameters should be specified: selection of a program to be tested and the optimization mode. Testing period, delay and tick generation settings will be hidden.
All available optimization options will be explained below.
Click " Test" in the context menu of an Expert Advisor in the Navigator window.
After that the Expert Advisor is selected in the Strategy Tester.
The Strategy Tester allows backtesting strategies that trade multiple symbols. Such trading robots are conventionally called multicurrency Expert Advisors.
The tester automatically downloads the history of required symbols from the trading platform (not from the trade server!) during the first call of the symbol data. Only the missing price history data are additionally downloaded from the trading server.
Before you start optimization of a multi-currency Expert Advisor, enable the symbols required for testing in the Market Watch. In the context menu, click " Symbols" and enable the required instruments.
Before you start optimization, select the financial instrument to test the trading robot operation on, the period and the mode.
Select the main chart for testing and optimization. Symbol selection is required to provide the triggering of OnTick() events contained in Expert Advisors. Also, the selected symbol and period affect special functions in the Expert Advisor code that use current chart parameters (for example, Symbol() and Period()). In other words, the chart to which the Expert Advisor is attached should be selected here.
Select testing and optimization period. You can select one of predefined periods or set a custom time interval. To set a custom period, enter the start and end dates in the appropriate fields to the right.
The specific feature of the tester is that it additionally downloads some data preceding the specified period (to form no less than 100 bars). This is required for a more accurate testing and optimization. For example, if you test on a one-week timeframe, two additional years are downloaded.
If there is not enough history data for forming additional 100 bars (it is especially significant for the monthly and weekly timeframes), for example, when specifying a start of testing close to the start of existing history data, then the start date of testing will be automatically shifted. An appropriate message is added to the Strategy Tester journal.
This option enables the verification of optimization results using a preset forward period in an effort to avoid overfitting in optimization time intervals. During forward optimization, the period set in the Date field is divided into two parts in accordance with the selected forward period (a half, one third, one fourth or a custom period when you specify the forward testings tart date).
Expert Advisor optimization is performed using the data of the first period. After that 10% (in the full search) or 25% (in the genetic algorithm) of best runs are selected and tested on the forward period. The results of the best optimization runs on both periods can be compared on tabs Optimization Results and Forward Results.
Strategy tester enabled the emulation of network delays during an Expert Advisor operation in order to provide close-to-real conditions for testing. A certain time delay is inserted between placing a trade request and its execution in the strategy tester. From the moment of request sending till its execution the price can change. This allows users to evaluate how trade processing speed affects the trading results.
In the instant execution mode, users can additionally check the EA's response to a requote from the trade server. If the difference between requested and execution prices exceeds the deviation value specified in the order, the EA receives a requote.
Please note that delays work only for trades performed by an EA (placing orders, changing stop levels, etc.). For example, if an EA uses pending orders, delays are only applied to order placing but not to order execution (in real conditions, execution occurs on the server without a network delay).
No Delay
In this mode, all orders are executed at requested prices without requotes. The mode is used to check how an EA would perform in "ideal" conditions.
Random Delay
The Random Delay mode allows testing an Expert Advisor in conditions maximally close to real ones. The delay value is generated as follows: a number from 0 to 9 is selected randomly - this is the number of seconds for a delay; if a selected number is equal to 9, another number from the same range is selected randomly and added to the first one.
Thus, the possibility of a delay for 0-8 seconds is 90%, possibility of a 9-18 second delay is 10%.
Fixed Delay
You can select one of the predefined delay values or set a custom one. The platform measures the ping to the trade server and allows you to set that value as a delay in the tester so that you are able to test a robot in the conditions that are as close to the real ones as possible.
Select one of the tick generation modes:
For more information about tick generation, please read the appropriate section.
Profit calculation in pips can speed up the testing process while there is no need to recalculate profit to deposit currency using conversion rates (and thus there is no need to download the appropriate price history). Swap and commission calculations are eliminated in this mode.
Please note that margin control is not performed in this mode. You should only use it for quick and rough strategy estimation and then check the obtained results using more accurate modes.
Specify the amount of the initial deposit used for testing and optimization. The deposit currency of the currently connected account is used by default, but you can specify any other currency. Please note that cross rates for converting profit and margin to the specified deposit currency must be available on the account, to ensure proper testing. Only symbols with the "Forex" or "Forex No Leverage" calculation type can be used as cross rates.
Next select the leverage for testing and optimization. The leverage influences the amount of funds reserved on the account as the margin on positions and orders.
If you have the source code of the selected Expert Advisor, you can click this button to switch to its editing in MetaEditor.
Use this menu to manage tester settings: save sets of settings for various Expert Advisors in ini files and access them in a couple of clicks later. Current optimization settings can also be copied to the clipboard by pressing Ctrl+C. You can edit them in your preferred text editor, then copy and upload them to the tester using Ctrl+V.
From the same menu, you can quickly select the last used programs, last chart settings and testing periods.
Furthermore, you can quickly access any of the previous optimization results, as well as the settings with which the result was achieved.
You can change the settings of the main trading instrument used for testing/optimization. Almost all specification parameters can be overwritten: volumes, trading modes, margin requirements, execution mode and other settings.
Set your own trading account parameters when testing strategies, such as trading limits, margin settings and commissions. This option enables the simulation of different trading conditions offered by brokers.
Select the optimization mode:
For more details about the available types please read the appropriate section.
Optimization criterion is a certain factor, which value defines the quality of a tested set of parameters. The higher the value of the optimization criterion, the better the testing result with the given set of parameters. It is only used for genetic optimization.
|
The quick optimization based on the genetic algorithm is enabled by selecting optimization criteria in the field located to the right. This field sets the parameter, based on which the most successful Expert Advisor runs are selected. The larger the value of a selected parameter, the better the result.
After setting all the parameters click "Start". This launches the process of testing and optimization.
|
Input parameters allow you to control the behavior of the Expert Advisor, adapting it to different market conditions and a specific financial instrument. For example, you can explore the Expert Advisor performance with different Stop Loss and Take Profit values, different periods of the moving average used for market analysis and decision-making, etc.
Optimization is testing different values and combinations of input parameters to obtain the best result.
To enable the optimization of a parameter, mark the appropriate checkbox. Next set the start and end of the range of values, as well as the step for testing. You can select one or more parameters. The total number of possible combinations is displayed beneath the list of parameters.
Parameter sets. You can at any time return to the current settings of your MQL5 program by saving a set of its parameters using a context menu:
You can specify custom trading account settings during strategy testing, such as trading limits, margin settings and commissions. This option enables the simulation of different trading conditions offered by brokers.
Common
In this section, you can set the maximum number of open orders and positions, which can simultaneously exist on the account. Additionally, you can configure sessions during which the program is not allowed to trade.
Margin
The section allows configuration of margin reserving rules and position accounting systems to be used in testing:
Risk management model: OTC and Exchange, netting or hedging.
When this level is reached, the account switches to the Margin Call state.
When this level is reached, all orders are canceled and all trading positions are closed. These levels can be indicated in money and in percentage. In the former case, they are determined as the account's Equity value. If "In percent" is selected, levels are defined as the account "Margin level" value (Equity/Margin*100).
The method of accounting for the current floating profit/loss in the free margin calculation is specified here:
The method of accounting for the trader's daily realized profit/loss in the free margin calculation is specified here:
Release fixed profit at the end of day — this option becomes available only if the option "Use daily fixed loss" is selected. If it is enabled, the accumulated profit will be released (and thus included in the free margin) at the end of the day. Otherwise this profit amount will remain blocked.
Commission
This section provides control over commissions charged on all trading operations:
To apply commission settings of the current trading account, enable the option "Use predefined commissions".
Enable the option to use current trading account commission settings instead of custom settings specified below.
Specify the name of the symbol for which you are configuring commissions. Several settings can be added for each symbol. Thus, you can set up multi-level commissions that depend on the deal volume or turnover.
Commission can be charged immediately after each trade, or it can be accumulated during the trading day or month and then charged in one operation:
Also, commission can be charged depending on each deal volume or on daily/monthly turnover. The selected option determines the entity whose volumes are indicated in the "From" and "To" fields: deal or turnover.
In the daily and monthly mode, commissions are charged for deals in both directions (when opening/increasing a position and when closing a position or part of it). For instant commissions, trade direction can be set manually.
For reversal deals with the in/out type, "In" means that commission is only charged on the volume of the newly opened position, "Out" means commission on the closed volume. The following rules shall apply for Close By deals:
The minimum deal volume (turnover) from which the commission will be charged. The ranges must not overlap. Otherwise, the commission will be charged for all the ranges, in which the operation falls.
The maximum deal volume (turnover) from which the commission will be charged. The ranges must not overlap.. Otherwise, the commission will be charged for all the ranges, in which the operation falls.
Commission fee amount. Commission units depend on the commission calculation method selected in the Mode field.
Minimum commission amount. Value units depend on the selected calculation mode (in the base currency, group currency, points. etc.). If you do not want to limit the minimum commission amount, set the 0 value.
Maximum commission amount. Value units depend on the selected calculation mode (in the base currency, group currency, points. etc.). The maximum commission value cannot be less than the minimum commission. If you do not want to limit the maximum commission amount, set the 0 value.
Commission fee calculation units:
Commission charging type:
You can overwrite settings of the main trading instrument, for which testing/optimization is performed. Almost all specification parameters can be overwritten: volumes, trading modes, margin requirements, execution mode and other settings. Thus, if you need to check an Expert Advisor under different conditions, there is no need to create a separate custom symbol and download its history. This can be done by changing standard symbol settings.
If the symbol specification is customized, the gear icon and the symbol icon are marked with an asterisk. This shows that custom parameters are used for the current test.
To start optimization, click "Start" on the "Settings" tab. The optimization progress is displayed to the left.
Detailed results of each optimization run are displayed on the "Optimization" tab. The tab contains general testing results, including profit and the number of trades, as well as many statistical values to help assess the performance of the trading robot.
See the Testing report section for details.
The optimization report can be sorted by any parameter by clicking on the column header. Use sorting to find the most profitable combination of parameters and run a single test for a detailed report.
The following values are displayed for each optimization run:
Using context menu commands you can show/hide some of the above columns. For convenience, check the "Switch to Optimization Results" option: once the optimization process is complete, the Strategy Tester will automatically switch to the Results tab. The same command is available in the context menu of the Journal tab.
Use filters to hide unsuccessful passes from the list:
The table with optimization results is colored as follows to enable a more efficient visual analysis:
|
The cache stores data about previously calculated optimization passes. The strategy tester stores the data to enable resuming of optimization after a pause and to avoid recalculation of already calculated test passes.
The optimization cache is stored in [Platform Data Directory]\Tester\cache as separate binary files for each set of optimized parameters of each Expert Advisor. Files are named according to the following rule: ExpertName.Symbol.Period.StartDate.EndDate.GenerationModeOptimizationMode.Hash.opt. Where:
Cache files allow viewing results of previous optimizations. Open the "Optimization results" tab, select an Expert Advisor and a file with the desired optimization cache:
The list contains all Expert Advisor optimization cache files available on the disk Optimization date, testing settings (symbol, timeframe and interval) and input parameters are shown for each file. You can additionally filter optimization results by the trade server.
From the result viewing mode, you can also change the optimization criterion, which you selected at the start of optimization. It is displayed in the Results tab and determines the quality of a tested set of input parameters. The higher the value of the optimization criterion, the better the testing pass is considered to be. Select the desired criterion from the list at the top of the tab, and the tester will automatically recalculate all values in the "Result" column.
To analyze results in third-party programs, for example, Office Excel, optimization report can be saved as a file through the "Export to XML" command of the context menu. Also, the context menu features commands for exporting and importing cache files. Use these commands to transfer optimization results between different platforms.
|
The Strategy Tester in the trading platform provides a powerful visualization system for presenting optimization results. Open "Optimization graph". The tab contains several types of charts, you can switch between them using the context menu.
All kinds of graphs, except flat have a zero line (or pane if it's a three-dimensional chart). If the balance value is used as the optimization criterion, this line usually means the initial deposit, allowing to visually separate loss-making and profitable passes. In all other cases this line is drawn on the zero value of the optimization criterion. |
A graph with optimization results opens by default. Each pass of an Expert Advisor with certain input parameters is displayed as a point on the graph. The number of a pass is shown on the horizontal axis, the value of the parameter that is the optimization criterion is shown on the vertical axis. The graph is colored with a green-to-red gradient, depending on the value of the optimization criterion.
The linear chart (1D) shows the variation of the parameter selected as the optimization criterion (vertical axis) depending on one of the optimization parameters selected for the horizontal axis. To select a parameter for the horizontal axis, use the "X Axis" command in the context menu.
In the two-dimensional graph mode, variations of the selected parameters used for optimization are shown on both axes. Variation of the optimization criterion is shown using the color gradient. The deeper the color, the higher the value of the optimization criterion.
In the three-dimensional visualization mode, changes of the selected parameters used for optimization are shown on the X and Y axes. Variation of the optimization criterion is displayed on the vertical Z axis and using a color gradient.
To select a parameters for the horizontal and vertical axes, use commands "X Axis" and "Y Axis" in the context menu.
3D chart management using a mouse
3D chart management using a keyboard
Action |
Keys |
---|---|
Show/hide the grid. |
G |
Switching between solid filling and filling with lines. |
Space |
The camera moves up (the chart moves down). |
Up Arrow |
The camera moves down (the chart moves up). |
Down Arrow |
The camera moves to the right (the chart moves to the left). |
Right Arrow |
The camera moves to the left (the chart moves to the right). |
Left Arrow |
The camera moves closer (zoom in the chart). |
Plus |
The camera moves away (zoom out the chart). |
Minus |
Rotate the graph downward around its horizontal axis. |
Home |
Rotate the graph upward around its horizontal axis. |
Page Up |
Rotate the graph around the vertical axis counterclockwise. |
End |
Rotate the graph around the vertical axis in a clockwise direction. |
Page Down |
Moving the zero plane upward by one. |
Ctrl+Arrow up |
Moving the zero plane downward by one. |
Ctrl+Arrow down |
Moving the zero plane upward by 10 units. |
Ctrl+Page Up |
Moving the zero plane downward by 10 units. |
Ctrl+Page Down |
Moving the zero plane to the maximum value of the graph. |
Ctrl+Home |
Moving the zero plane to the minimum value of the graph. |
Ctrl+End |
Increasing the transparency of the zero plane. |
Ctrl+Plus |
Reducing the transparency of the zero plane. |
Ctrl+Minus |
Setting the maximum transparency of the zero plane (it disappears). |
Ctrl+Right Arrow |
Setting the minimum transparency of the zero plane (it becomes nontransparent). |
Ctrl+Left Arrow |
Reset to default graph settings. |
"5" key on the num pad. |
Forward testing is the repeated run of the best optimization results on a different time period. This feature allows you to avoid parameters fitting in certain areas of historical data.
To start the forward testing, in the Forward field of the Settings tab select the part of the total period for it:
|
The selected part is separated from the period specified in the "Date" field. The first part is the period of back testing, and the second one is the period of forward testing.
The full optimization (slow or fast) of the Expert Advisor is conducted on the back testing period. After that 10% (in the full search) or 25% (in the genetic algorithm) of best runs are selected and then tested on the forward period.
There is a lower limit for the number of passes of forward testing. If the number of best runs is less than 256, the additional best runs are used for forward testing until their number reaches 256. If the number of all runs is less than 256, all of them participate in forward testing. |
Results of back and forward testing can be compared on the "Optimization Results" (select "Forward testing results" in the context menu) and "Forward Results" tabs. The better the results coincide, the more likely it is that the Expert Advisor will show good results in real trading.
The visualization of optimization results on the forward period is available on the "Forward optimization graph" tab. To compare these results with the backtest, switch between them using the context menu.
For details about testing results please read sections "Where to view the optimization results" and "Visualization of optimization results".
The multithreaded Strategy Tester uses all available computer resources. Testing and optimization are carried out using special computing agents that are installed as services on the user's computer. Agents work independently and calculate optimization passes in parallel.
Three types of agents are available: local, remote and cloud (MQL5 Cloud Network). Local agents are installed automatically when you install the trading platform. Their number is equal to the number of logical cores of the computer.
Remote and cloud agents run on other computers. For detailed information about agents, please read "How to speed up optimization using a local farm of agents" and "How to speed up optimization using MQL5 Cloud Network".
Open the "Agents" section in the Strategy Tester and select the type of agents you want to use for optimization.
You can purchase a processor with more cores, but it does not allow to multiply the number of concurrent tasks. You can create your own farm of processing agents in your local network.
Install agents on each computer of the local network. If the platform is installed on a computer, open testing agents manager using the "Tools" menu.
Otherwise, download a separate application for managing agents Trade Master 9 Strategy Tester Agent and go through the simple installation process.
On the Services tab of the manager:
After installation, the agents are available for use from other computers on the local network.
Remote agents can only be used in 64 bit systems. To save traffic and disk space, as well as for security reasons:
|
Open the Strategy Tester. On tab "Agents", select "Local Network Farm" and click "Add" in the context menu.
The easiest and fastest way is to automatically scan the local network for a range of IP addresses and ports. Select them and enter the agent connection password that was specified during installation.
Click "Finish" and all the found agents become available for testing.
Other options to add agents:
Agents installed on the computer using MetaTester 5 Agents Manager, can be connected as remote on the same computer. If the processor cores have extra computation power during calculations, they can take a higher load to use all the computing capacity. |
To change the settings, click the " Edit" command in its context menu.
The following fields are available in the settings window:
In settings of local agents only the option of enabling/disabling them is available.
To make setting up of remote agents easier, the platform provides a feature for importing and exporting their settings. The files of settings have the *.TM9 extension. The import and export commands are located in the context menu of the "Agents" tab.
Files of settings have the following format: Name;Address:port;Password;Description;Enable.
Settings of different agents are separated from each other with line breaks.
The MQL5 Cloud Network allows you to quickly optimize your Expert Advisors using the power of thousands of computers. The network combines remote agents and distributes optimization tasks among them. The Strategy Tester connects to the cloud network through multiple access points, which are distributed on a territorial basis (e.g., MQL5 Cloud Europe).
To use the network agents, enable them using command " Enable" in the context menu. Since the MQL5 Cloud Network is a paid service, a user must have an account at the MQL5.community website, through which all the accounting operations are performed. Account details are specified on the MQL5.community tab of the platform settings.
If you do not specify the details of your MQL5.community account before enabling the MQL5 Cloud Network agents, you will be offered to do this.
If you have not registered on the website, use the new account creation link.
Like with a conventional optimization, you need to set all the testing options and Expert Advisor input parameters. On the Agents tab, you can monitor how the Strategy Tester distributes tasks to available agents. The number of available and currently used agents is displayed for each access point.
Traders may need to run hundreds of thousands of optimization passes in a reasonable time. With the multi-threaded Strategy Tester and the MQL5 Cloud Network, in one hour you can complete the calculations that would require a few days without the network. The computing power of thousands of cores is available straight on the trading platform.
There are limitations for each optimization pass. During optimization, the Expert Advisor cannot write more than 4GB of information to disk and use more than 4GB of RAM. If the limit is exceeded, the network agent will not be able to complete the calculation correctly, and you will not receive the result. However, you will be charged for all the time spent on the calculations. |