Should you trade with Jev? My verdict after testing it
Part 6 of 6 · Jev in trading, tested
Should you trade with Jev? Not on price data, not yet. I haven't found anyone who
has shown it beats a simple model at reading a market, and in my own test it read
Bitcoin's indicators the wrong way round. Where Jev does look useful is on jobs where the
answer is already in the data: classifying, checking, reading a label off a list. Keep
it out of the order path until you've backtested it.
What this series set out to answer
Jev showed up everywhere in September 2026, and trading bots appeared next to the game
demos. I wanted to know whether any of it worked on a market, so I followed the trail:
| Part | Question | Short answer |
|---|---|---|
| 1 | Is anyone showing results trading with Jev? | 19 projects read; mostly demos; 4 compared Jev with something simpler and Jev didn't win |
| 2 | Is QuantDinger, the biggest one, safe for real money? | solid order handling; account risk limits not wired into live trading |
| 3 | What's worth copying from its bots? | three exit layers; not the martingale (20–250 wins to repay one loss) |
| 4 | How does it use Jev? | as an entry veto; sensible rules, but fail-open and impossible to backtest |
| 5 | Can Jev read a market at all? | not on 1,500 unseen BTC 5m candles: AUC 0.486 vs 0.522 for a plain model |
Why the hype and the evidence don't match
Three reasons, I think.
Demos are easy and they look good. A bot that asks Jev "buy or sell?" twice a second
and draws a live chart takes a weekend. Measuring whether it beats "always predict down"
takes longer, and nobody shares a chart of that.
A probability looks like knowledge. Jev answers 0.63 instead of "maybe", which feels
precise. But in my test its up-probabilities moved with the indicators in the textbook
direction, confidently, and the market went the other way. Precise isn't the same as
right.
Almost nobody runs a baseline. Of the 12 trading projects in part 1, four compared
Jev with anything simpler. That's the step that separates a demo from evidence.
Is Jev useless, then?
No. It reads structured data very accurately: my control questions ("is RSI above 50?")
came back 99.8% correct. And the projects outside trading tell a better story:
| Task | Jev | Comparison |
|---|---|---|
| Banking customer intents (77 labels) | 92.4%, about $0.00014 a call | fine-tuned BERT 93.66% |
| Reviewing trade journals for rule breaks (one demo set) | 96.7%, caught 74 of 74 wrong notes | n/a |
| Next-candle direction, BTC 5m (my test) | AUC 0.486 | plain boosting 0.522 |
The pattern: Jev is good when the answer is in the input and it has to find or label
it. It's weak when the answer is in the future and depends on how one market actually
behaves, which isn't something a model trained on text has been fitted to.
So if I used it in a trading business, it'd be for the paperwork around trading
(tagging trades, checking a journal against the rules, sorting support emails), not for
the trades.
A checklist for any "AI trading" claim
Whether it's Jev or anything else, I'd want these five answered before trusting it with
money:
- Compared with what? A simple rule or a plain model, on the same data.
- On data it hadn't seen? A separate test period, chosen before looking.
- After costs? Spread, fees, slippage. My test's best signal made under 1 basis point
a trade; fees are 15 to 20. - Does it read the inputs correctly? Control questions with known answers, so you
know a bad result isn't a parsing problem. - What happens when it fails or isn't sure? If the answer is "the trade goes through",
the AI is decoration.
What I'm taking into my own EAs
I write MT4/MT5 EAs, which QuantDinger doesn't run, so this is about what carries over.
Not Jev. What I'm keeping from all this is the unglamorous part from
part 3, ported to MQL5: a stop on the whole EA's equity, not just per
trade, and a trailing stop that only activates once a trade has worked. And a rule for
anything I add later: no model goes in front of an order until I've backtested it with
and without the model on the same tick data.
What would change my mind
- A newer Jev version passing the same test. The code is public:
github.com/truongxxxx/jev-btc-test. Rerun
it with a new model name and it costs about $0.19. - Anyone publishing a Jev trading result against a baseline, on unseen data, after costs.
I'd happily write that up. - A task where the information isn't in the price (news, filings, order flow), which I
haven't tested.
Everything here is a snapshot of late September 2026. Jev is moving fast, and the Bitcoin
test is cheap to rerun whenever a new version ships.
Comments
No comments yet. Questions about the settings, the data or the numbers are welcome.
Log in or create a free account to comment.