ProRealAlgos? Real or fake
Forums › ProRealTime English forum › General trading discussions › ProRealAlgos? Real or fake
- This topic has 226 replies, 29 voices, and was last updated 1 year ago by ProRealAlgos.
Tagged: ProRealAlgos
-
-
10/25/2023 at 7:06 PM #222921
You look like ChatGPT now. You managed to give Alan the same kind of replies as you did to me. “We dig that hard” and “we chase you” etc. etc. No … people just have memories. And that includes the setup of Trustpilot and Market Place reviews you are so keen about. Well, actually they kill you. I look deeper without the necessity to look.
It is simple : if you are on the Market Place from Nicolas, then where are all the responses from people of the ProrealCode community ? there is none.
No wait, there are negative ones, but I did not count them (hence, no I do not dig at all or else I would have counted). But counting to zero goes implicitly. Just no memory of good responses.So yes, you are the best and the greatest and everything. But you know … it is fake. In my view it is. Never shown some code but with mistakes. Does the most odd things with ChatGPT. Nothing makes sense. And btw not to me, it just doesn’t. “You preferred to stay in this thread, PeterSt”, you said (similar). But as you will remember (perhaps), I told you I would continue if you would. And since you do, here you have it.
I tried to write a balanced post (the one addressing Gauvel – it was in favor of you), but you preferred to throw with dirt again. As you do with your customers. Read back on how sour you are.
10/25/2023 at 7:33 PM #222923Hi Peter. On the opposite I think I’m trying to be as objective and specific as possible, adressing point per point to try to understand, without mixing in feelings/hards words.
Generally I feel that the sporadic criticism is pretty vague without any concrete examples. Just general negative proclamations predominantly by users who never have been clients of ProRealAlgos, you included.
Of course I’m active in the thread about our business. Sorry I don’t get that point.
Perhaps forum mods object to the discussions in this thread. I prefer to allow all kinds of criticism towards us, as it gives up opportunity to answer it and it aligns with our goal to be as transparent as possivble.
Now, have a good night Peter and enjoy some time away from this thread. Best regards / Carl
10/25/2023 at 7:55 PM #222924“The slightest hint of half a word towards adding a reply to the reply of the reply of an argument which started somewhere else (…)”
This was very clearly about your uncalled-for dig at CfdAuto about names, which had nothing to do in this conversation. You had a go, he had a reply, and I did put an end to this before a never ending cycle of replies. That’s all it was, and you know it…
Everything else so far, queries, challenges, answers, I’ve let all posts in full so far.
In what universe does that become “Perhaps forum mods object to the discussions in this thread, I prefer to allow…”.
Don’t drag me into this… If you have complaints about how the moderation is done, please feel free to email Nicolas, I have absolutly no problem with that.
10/25/2023 at 8:03 PM #222925What’s going on here… Maybe some live data should just be shared here to refute any allegations? That would be proof enough that it works… or not. It has been a difficult time for many algos on NASDAQ and SP500 since July. It goes sideways with a downward trend. So a difficult environment for algos that were developed in smaller TFs and tend to be over-optimized and are now collapsing. By the way… 2 of the 3 shared algos in their library are crashing right now. But… that happens with pretty much every algo right now in M1 or M5. I can say from my own experience that there are very few who continue to make good profits. But now I know what I have to pay attention to. So share some live data as proof…. otherwise some people here never let up. Whether good or bad remains to be seen.
1 user thanked author for this post.
10/25/2023 at 8:38 PM #222929Hi JC_Bylwan. My latest post and mention of what mod thought of this discussion was genuinly by interest to follow the rules.
It was not my intention to critize anything regarding the moderation with cfda, but now as you bring that up, perhaps I should mention that the best way to achieve objectivity would have been to delete the posts of both of us, or none of us and not just delete one reply and lock the thread. But water under the bridge and so forth, I’ve let that go.
But thanks about your comment about you letting these kinds of discussions through. Genuinly only wanted to make sure that was the case.
Have a good one / Carl
10/25/2023 at 8:42 PM #222930Hi Phoentz. Thanks for asking! I’m not sure what’s going on here actually but it’s an endless array of messages for me to respond to. Lol. I don’t get time to do anything else.
So regarding live data, on our website the visitor can now since the start of this week follow all trades of all algos live.
Also, don’t know if it serves as proof but on the results page on our website you can see screenshots inside of ProRealTime for every year since we started our business.
Let me get back to you regarding your general points tomorrow. Algo trading sure is hard, and only a few systems actually make it year after year.
Have to sleep now! Good night y’all
10/26/2023 at 12:55 AM #22293110/26/2023 at 4:19 AM #222932If not, then Carl and the other names will tell how to do that; sure ready to learn here !
I have only access to 6months for 1 min data. Can I get more? I here/read about a million bars as part of PRT sales speak but it is not the case for me on any time frame. Maybe some instrument I don’t use like forex. Try build something for HK I get even less but have robust algos for that.
The only way I can really do this is to build on 3-6months, then incubate for 3-6 months for OOS. Then live test is the best teacher.
I think given the conversation and recent topic of correlation perhaps this is a great chance for you Carl to share more about ways PRA might process months of consecutive losses and weigh in on. I’ve shared some of mine which I have not a doubt in my mind others here like Phoentz has shared his 5 in Bot which also fell over. So did the Larry Conners strategy. I have 6 of my own NDQ longs which all are in DD. I look around at Market place and NDQ bots are no longer on the front page. Very telling IMO.
It looks like the example I demonstrated is curve fitted for sure. If it hadn’t had the months of run-up before hand of which I had, just at smaller size then no way would I had held it into second bottomless draw down. Now, my algo doesn’t know the PA is grinding lower and so it takes death by 1000 cuts. But I know this is somewhat expected at this time of year and I know the Nasdaq doesn’t like high yields and poor breadth. So only I know the bot has to be switched of until a later date. But you can’t do that when a system is sold to someone it has to be backed up by something or size itself down surely?
…and in my eyes this is why losing is so common even with someone elses system. Without conviction of creation and understanding of the logic and fail safe methodology, one is left with the decision to ‘trade the system’ by trying to outperform it using their own market knowledge. This is the main point I am hearing in the thread, (I mean not knowing the logic).
In my mind detailing PRA’s approach could turn the thread around somewhat and become more constructive for us all.
I am testing Dynamic position Sizing but as with a lot of these things, they are not better overall in early tests.
I say, away from correlation now and onto curve fitting that I can have many many 1 min systems that were built on 30-40 trades and surprise me every quarter and over 1 year now. The Doji I show built on best practice with 150+ trades is so frequent that the event I demonstrate was sure to come (in hindsight) and was bang on the worst MonteCarlo result at 25% DD.
From what I can tell PRA are in the same boat and I think we all pray for more infinite QE or Presidential seasonality to kick in haaahhaa, just for easy money.
Does anyone know the code for ‘Downfall of the Dollar’ or ‘WWIII’ or ‘Digital Yuan” as I can’t find it in the manual.
GL all
10/26/2023 at 7:53 AM #2229391 million bars is available under PRT Premium. I use it to test with 6 months 1minute data, to next discover that the data beyond that (towards the past) in 100% of cases is overfitted. I know that it happens – I know I need to avoid that, but it happens anyway, always. That’s why my question to Carl (which is rhetoric).
I sat down to analyse what all to avoid (which in the end is all obvious) and recently I developed systems which work at the second level – pure technical systems. Message here : with 3 seconds and 1M available bars, I use 3 weeks to test and tune the system and I have ~6 weeks more for sanity checking the overfitting.
More should not be necessary because I now make all independent of markets. The tip I already have by now : don’t expect many trades (like maybe 1-2 per day) and don’t expect much profit (in points) as well.Note : We can’t test each other’s overfitting, like I could let loose 1M bars on your System, unless it is free of Market Place royalties. But you can do that yourself :
Just run the past over it for as much as you have (like 200K bars) and observe the “bend” where DD starts. Now bet with yourself that that was the date the particular system was ready and put to the Market Place. So what you can see from the past – where the system started to be developed (like in your case today 200K bars ago) will happen just the same for the future – you put your system Live 2 months ago, then backtesting it today will show the peak at exactly 2 months ago. OK, you knew that. But it is telling about 3rd party Systems. You could show us a few, for mutual fun. But if you can’t … hey … then Carl is right. But if not, then Carl, no stories / excuses about coincidental markets please. Remember what I told : this is all to be expected. With you – with everybody/every instance.🙂
1 user thanked author for this post.
10/26/2023 at 8:33 AM #222940Thank you Allan. Let’s agree to disagree.
Coincatcha, yes you can get access to a million bars with ProRealTime premium as Peter said. With that you should get 9months of data on the 1 minute timeframe, compared to 2 months of data with the basic version. I’m sending you the link here: https://www.prorealtime.com/en/ProRealTime-Premium.
I agree, I think us sharing our approach to avoid overfitting and our development process in general could help others. We’ve done some videos on the topic of algo development and more is coming.
I will try to write a more complete thread on the topic later. Any way, on this topic you can watch a video here where we are covering the essentials of optimization https://youtu.be/Pu1P7o3syHM?si=XomwIjFqlfnw-x4EPeter is on to something here on the topic of evaluating algos that I agree with. The best way to evaluate and check if a system is overfitted is to first verify which date that EXACT VERSION of that EXACT ALGO was released. Some algo developers are continously releasing “new versions” of their algos and then attribute/claim historic results of another version to this new version saying that it’s been live for years. A new version should be considered a new system and should be evaluated accordingly. So, find out when the latest “version” was released, save it for a couple of months and then run a backtest of it and evaluate the results from the release date until today. THAT’S THE ONLY RESULTS THAT MATTER. This approach will save you alot of €€€ from not running overfitted systems.
1 user thanked author for this post.
10/26/2023 at 8:55 AM #222942Personally, I have written many, many algos, sometimes x different versions of the same procedure. When I look through my library from time to time and pull out systems again after x months, I see how they have developed without being touched. This is how I figured out useful things for TFs in 1, 5, 15 minutes. What could matter. For example, it seems to make sense to consider a high TF from H4 for a trend. Or fixed sizes like Dhigh/Dlow/Dclose, or a weekly close. Things that are always there and cannot be optimized. If you build systems around it, you have a high chance of getting something robust. These are my findings from the last few months.
2 users thanked author for this post.
10/26/2023 at 12:01 PM #222951For example, it seems to make sense to consider a high TF from H4 for a trend.
Thanks PeterSt and Carl, this is all very constructive and helpful to an algo junior. To be clear I have used the algo live since April already just with 2 contracts not 8. So the bot was actually built with some bear market data and did very well indeed until July 14th, thus making it harder to accept its current failure and every other other ndq long I can get my hands on. Anyway, I will take this all on board and check my notes on how I developed this system to improve my process.
Phoentz, I must say you are also spot on here to my limited experience also. My ‘B grade’ systems (18) in my main account nearly all have MTF and largely just above/below a 4hr ema. They produce very acceptable equity curves once properly risk adjusted but are not productive enough to live off at my size….yet. They were each built on less than 50 trades trading 1-4 times per month and remain relevant today. If I had 1/4mill for trading I could derive a liveable income off of these alone.
The portfolio discussion may deserve another thread but this is why I am grateful for PRA to be active on the forum and have a detailed website with live performance and see how many algos get switched on/off and how they are balanced. I have watched a few of the videos and look forward to more.
10/26/2023 at 12:53 PM #222955It is often very beneficial to allow a maximum of one position per day. Especially in sideways phases, a trend system loses because it tries to make a profit in every direction but is caught by the SL. Back and forth makes pockets empty.
1 user thanked author for this post.
10/28/2023 at 2:33 PM #223001Gaveul, just to clarify, you are saying that you are NOT doubting the overall returns of the last 3 years, right? Just to clarify as that sentence was a bit ambigious.
Answer : Since I wasn’t using your portfolio before, I cannot assert nor deny theses points
Yeah, I really get that you want as many authentic strategies as possible – and that’s why we are proud to say that we’re the one developer offering the highest number of different strategies. You get all of them when buying the All algos license from us. As mentioned they are 12 completely different strategies and codes, and more are being added as we speak.
Answer : Heavily correlated in my opinion. Too much risk is involved.
I see again that you are referring to a -€7k drawdown, but the drawdown from our ATH(aug 1st) to the latest datapoint (oct 1st) is -€2,67k (€36619-€33953). That should be put in perspective of the +€7,4k gains from January until Aug 1st.
So far in October we are at a loss, but we’ll see the end results for the full month in a week but overall we are at good profits this year.Answer : Well the backtests I ran on the portfolio you sent was in a 7k drawdown ( CF picture ). If I rerun it today it would probably be around a -9k drawdown. By the way, the money I have lost in 2 weeks is way higher than the ‘current drawdown’ you’re assuming for from aug 1st to oct 1st.
As you have only run the algos for a couple of days yourself I assume that you are basing that -€7k number on something else, perhaps the livetrades site on our webpage, which until just a few days ago were showing trades from algos that were stopped months ago and didn’t include any new algos released. This I have explained to you. So any results you see on the livetrades site are correct starting this week but not before that.
Answer : So it has been month with invalid live feed ? It is kind of weird and not very serious.
Regarding your question why some algos does not start before 2015, I don’t understand what you mean. There are no limitations built in to the algo on how far back you can make a backtest. Any limitations of the time period of a backtest is solely related to the historic data you have access to. You might not have data before 2015.
Answer : I have access to much more data than that. The system just doesn’t want to trade. Maybe you’ve put a condition that exclude trading before a certain date ?
I don’t agree that a daily correlation analysis should be the predominant way to make correlation analysis. You say that it’s still too high in the weekly based approach. If you’ve done such an analysis it would be interesting to see but again… I think you agree, that we are wasting time discussing details regarding a correlation analysis, based on trades produced by a blunt backtest instead of trying to re-make this correlation analysis with real true trades. The correlation analysis and the conclusions you can draw from that, can by definition never be better than the quality of the input data.
Answer : . I don’t doubt the backtests I have. I can doubt the livetrade trackrecord you can provide.
You didn’t answer me on my Sharpe Ratio question
10/28/2023 at 4:19 PM #223003Maybe you’ve put a condition that exclude trading before a certain date ?
What a dishonest question !
hahaAll I can tell from personal experience is that one of the more known vendors on the Market Place had indeed built in hardcoded dates for the Backtest you could run on a trial version he/she provided.
Yes, unbelievable, right ? This is the way to do it :- Run a backtest on your quite random algo;
- Find out the trades which go bad;
- In de code, exclude those small periods of time of trading around entry times of the bad going trades, hence make dead zones;
- Run the backtest again to check once more for the result.
- Looks good enough and not too good ? then make that available as a trial version.
I never reported this and I don’t plan to either. Do notice that I worked this out with a few others.
So this is your theoretical prospectus when buying/renting from the market place. I don’t know whether this is a common trick. The other trick, of course, is picking a Detailed Report which looks like real data, and cut out the Title Bar and thus don’t show the “Demo” icon. And you know what ? from of the moment that was laid out a couple of months ago, no single report has been presented from any of the vendors. And worse, on this occasion the other day I myself asked to present the Detailed Report including that icon … it never happened.
Similarly we are waiting for the curve being still fine from Marco and Carl and the others. I would have expected it to be there by now.
-
AuthorPosts
Find exclusive trading pro-tools on