AI in trading: uses, testing and limitations

AI in trading means using artificial intelligence models to work with market information, trade records or trading rules. A model may help identify patterns, write code or produce forecasts. A useful explanation, an accurate forecast and a profitable trading method are different outcomes. Each needs its own check.

Chatbots, forecasting models and trading bots

A chatbot produces text, explanations or code in response to a request. A forecasting model estimates a defined outcome from input data. A trading bot sends orders, instructions to buy or sell, under specified rules. One service can combine these functions, but a chat window alone does not establish access to market prices or permission to trade.

A bot can follow fixed rules without machine learning. A model can also analyse data without sending an order. First establish what the tool actually does: explains information, estimates an outcome or controls execution. Sending orders requires a separate connection, permissions and controls over the instructions it sends.

Chatbots generate text or code, forecasting models estimate outcomes, and trading bots send orders with separate connections and permissions.

Machine learning fits a model using examples. A language model learns to generate text, so a confident explanation does not establish that its calculation or market claim is correct. NIST's guidance on generative AI identifies the risk of confidently presented false content, including invented reasoning and citations.

If an answer includes a current price, check the data source and timestamp. The service may lack market access or receive delayed prices. A chart screenshot contains only the selected view; it cannot establish every trade, the full traded quantity or your actual execution prices. Chart reading explains how to check the underlying chart information.

Three checks for an AI trading forecast: verify the data source and timestamp, compare complete records with a screenshot, and test outcomes against a baseline.

Can AI predict the price accurately?

AI can forecast a future price, direction or movement range, but it cannot guarantee the outcome. Its performance depends on the task, time horizon, data and testing on new observations. There is no universal number of days after which every model becomes no better than random guessing.

Define the forecast before evaluating it. Tomorrow's closing price, the direction of the next candle and the chance of a large move are different tasks. Correct direction does not establish the size of the move or a profit after costs. Compare the model with a simple starting rule to see whether it adds useful information.

Unexpected news and changes in market participants or trading conditions can weaken patterns found in past data. This does not make every model useless. It means performance needs monitoring in the market and conditions where the model is used, rather than transferring an advertised result to any trade.

A percentage typed into a chat answer is not automatically a measured probability. You need a defined event, a calculation method and evidence that predictions correspond to actual outcomes. Without those checks, treat the statement as an idea to investigate.

Using AI to analyse your trades

A trading journal records completed trades and your actions. AI may help group those records by instrument, time, entry rule or documented departures from the plan. This describes what happened; it does not reveal the next market price.

Prepare a table with clear fields: entry and exit times with the time zone, instrument, direction, trade size, execution prices, costs and result. Include a rule violation only when your records establish it. A losing trade alone does not tell a model that you felt afraid or broke a rule.

Ask the tool to identify missing entries, duplicates and unclear units before grouping the records. Check totals against your broker's statement or your own calculation. Mixing currencies, treating open trades as closed or omitting commissions can produce a tidy table with an incorrect result.

Check missing rows, duplicates and unclear units, then reconcile totals; mixed currencies, open trades and omitted costs can distort results.

A specific request is easier to check than 'find a profitable strategy': 'Group these closed trades by entry time. Show the number of trades, total result after the listed commissions and rows with missing data. Do not fill in missing values.' Then compare several rows from each group and the overall total with the original table.

An observed relationship does not establish its cause. Losses during particular hours may reflect a different instrument, larger trades or too few observations. Turn the finding into a condition you can test on later data before changing your trading because the report looks convincing.

Testing a strategy suggested by AI

Convert an AI suggestion into clear trading rules first: what data is available at the decision time, what triggers an entry, when the trade ends and how its size is limited. If the explanation changes after every question, there is no stable method to test yet. A trading system explains how to turn conditions into a written plan and evaluate its results.

Generated code can help automate a test, but it may calculate an indicator incorrectly, place a signal at the wrong time or assume an unavailable execution price. A successful program run and an attractive chart do not prove correctness. Check individual cases manually: what was known before entry, why an order appeared and how its result was calculated.

Overfitting occurs when a model fits the peculiarities of its training data too closely and performs poorly on new data. In trading, testing many settings and selecting the best historical result can create this problem. David Bailey and his co-authors studied this selection risk in historical strategy tests.

Data leakage means a test uses information that was not available when the decision would have been made. For example, an entry during a candle cannot use that candle's final high before it is known. Leakage can also enter through preparation when data-processing settings are calculated from the entire history, including the later test period.

An entry during a candle cannot use its unknown final high; preparation can also leak information from a later test period.

Fit the rules on earlier data and check them on later data without using future results in the earlier decisions. If you change the rules after examining the test, that period becomes part of the selection process; another independent check is needed. Where inputs or forecast outcomes span overlapping periods, a calendar split alone may not prevent information from crossing the boundary.

Fit on earlier data and test on later data; changing rules after reviewing the test requires a new independent check, and overlapping periods can cross the boundary.

Check money gained and lost, not just the percentage of correct calls. In a hypothetical set of ten closed trades measured in US dollars, six gain $10 each and four lose $20 each. The result before costs is 6 × $10 − 4 × $20 = −$20, despite a majority of winning trades. Commissions make it worse. These numbers illustrate arithmetic, not my results or a tested AI model.

Hypothetical ten-trade arithmetic in USD: six gains of10 and four losses of20 produce a20-dollar loss before costs.

Check execution assumptions too. A chart price used to create a signal may not have been available for an immediate trade. Include the difference between buying and selling prices, commissions and slippage, the difference between expected and actual execution price. Then observe the tool on new data and in a demo environment using virtual funds. Successful simulated execution does not establish the same fills in a real account.

Data and account risks

Remove account numbers, identity documents, passwords and access keys before uploading records. Check how the service stores and uses your information. Analysing a table does not require permission to withdraw money or send orders. If the tool connects to an account, separately limit its permissions and check how to stop it.

Remove sensitive identifiers and credentials before uploading records; separately limit account permissions and verify how to stop a connection.

An automated system needs limits on order size and open trades, checks for duplicate orders and a defined response to a lost connection. Model or data-source updates can change behaviour, so keep versions of the rules and records of sent orders. Investigate unexplained changes without new trades rather than relying on the next answer to repair them.

Guaranteed profit or trading without losses is a reason to investigate a service, not evidence that its technology works. SEC, FINRA and CFTC educational materials warn about offers using AI claims to promote unrealistic results. Check the company and service terms through independent sources. A demo balance or profit screenshot does not establish a real trading history.

Connecting AI assistance to a trading method

My course builds decisions around observable chart conditions and rules chosen before the trade, rather than an assurance of predicting every price. The Wyckoff method explains the price-and-volume approach in more detail. AI can help organise observations, but a relationship it finds still needs checking against the actual data.

In the course section on expected value, I compare hypothetical trade series with specified loss exits and profit targets. The practical task is to evaluate the series rather than one successful trade. This helps frame the evaluation of an idea; it is neither an AI programming lesson nor evidence of future profitability.

The optional Price forecasting limits chapter discusses choosing a trading task instead of expecting an exact future price. It does not test a specific AI model or rule out forecasts expressed as probabilities. The written checks in this article can be followed without watching the video.

As with trading indicators, a model's output needs clear conditions of use. Write down the task, data source and timestamp, what counts as a correct answer and what you will do when it is wrong. If you cannot reproduce and check the result, it is not enough evidence for a trade.

Frequently asked questions

How can you use AI in trading?

Use it to organise information, examine trade records, prepare code and develop ideas you can test. Define the task and check the input data first, then verify calculations and conclusions. A confident answer alone does not establish correctness.

About the author

Igor Arapov, practising trader since 2013 and author of the ArapovTrade learning library. ORCID: 0009-0003-0430-778X.

PREVIOUS ARTICLE
NEXT ARTICLE