Portfolio Detailed Report – What Use is it??

Forums ProRealTime English forum ProRealTime platform support Portfolio Detailed Report – What Use is it??

Viewing 12 posts - 16 through 27 (of 27 total)
  • #240923
    Just catching a few manual trades … hoping USA still sleepily-stuffed with turkey after yesterday’s binge! 😀

    I just saw open positions with red crosses

    I regularly / daily check for red crosses under Trading > Open Trades … for Algo trades ended up as manual trades … is this what your reference to red crosses is about?

    Haha, yes. And it was rare to see finally see such a steady moving-forward day again.
    Anyway indeed; Below the very example, with the two open positions I found in “manual mode” (red crosses instead of greyed out crosses) still there.
    Further more (one of the other posts from me), we can imagine that once such a position / trade is closed, it won’t match any more with the opening trade, and thus the statistics don’t know where to place it. It can’t be under Manual and it can’t be under Auto. But the database with PRT’s is molested because of this as well. So also the normal “all trades” does not work out any more in the statistics.
    The kind of special topic with this is that this requires some form of manual repair of their database (the part where I reside, or maybe it’s a database dedicated to me – hard to imagine that with updates to it (new fields and such)). And I never got PRT as far as repairing this kind of stuf. Possibly they are good at stuffing turkeys ?

    From this, another special issue follows : if they don’t repair this soon enough (they didn’t), it can’t be repaired. It creeps into everything and there will no base for the truth any more (this may follow from my upcoming response to druby’s post). GraHal, I think you (ever back ?) provided support to users of  (an)ERP system(s) so this will tell you something. Would you be on the development side of these matters, you would know what a huge task it is to repair a database from still decent left overs (possibly start from a backup and roll forward, avoiding the same issues that molested the lot).

    And so yet another issue in the still same realm of your thread, is that PRT does not feel any responsibility of financial decent systems. The sheer fact that I can not see my money any more by any means, is telling. It is so much telling …
    This imposes yet another issue, and this is about the fact that PRT relies to what the data at the broker is. And this is enormously complicated in itself. Would you trade Futures, as in the real ones like with IBKR, you would be able to see through the complexity of how financial figures should be reported in the first place. Take the past two days as an example to the extreme : Thursday no Settlement. Friday also no settlement. This means that upcoming Monday the daily figures continue with the starting figures of Thursday 00:00 my time (23:00 Wednesday your time). This also means that my daily profit is bound to that. Thus, Monday morning (and beyond) I will see the accumulated gain from Thursday, Friday and Monday itself. Ever thought of this ? Ever thought of something like DAX *is* settling on these USA-holidays ? and that this happens at another time anyway (like 17:30 my time). Ever thought of the impossibility of looking reliably to your daily profit because of this alone, which actually is a normal thing ? … now try to observe this through error.
    I never ever could point out any mistakes on the side of IBKR (hence, their systems should be super decent and their database is fine). However, to sort out one single issue exhibiting on the PRT side of matters may take half a day or more. And then to think that if PRT is doing the sorting-out, they first must rely on what I tell them, which is a derivative of what I saw happening. Hence and once again : once something is neglected for a day or two, all is obfuscated and nobody knows where to start any more. It is just too late. Meanwhile the errors keep accumulating.

    Regarding the latter, this is also about the nasty hot-sauce the 2nd screenshot testifies of. This is a simple system I am trialing, running on its own in an account. So, all easy to track  (/ trace) you would say. But it is exactly this why I can see these things happening, which I would never be able to in the midst of another gazillion trades. I-have-no-clue what happens there, and it happens at least once a day. The system does not contain any “Bestens” (= Market) orders, but this happens (watch the times). This is about the (computer-)communication between PRT and IB. This is also about the complexity of synchronisation. I don’t really complain about it, but when not all is covered for in your own program code, out goes your system and in creeps another inconsistency in the database. And btw, would you think their will be any realism in presenting this very issue to PRT to sort it out ? … they would not know where to start. And thus this issue will remain forever, until I find the culprit myself and am able to change something in the program code so it will not happen again.

    It is one huge pile of issues, the one implying the other (or not). I repeat : nothing of this will show or really bother when using Demo – obviously.

    Something very else is : ProRealTime acts as a provider for us. Do we ever realise that this is quite special in this world ? This does not happen at all with the other platforms. There you are on your own from start to finish, and if something does not work it will be your own program code with nothing in between you and the broker + exchange. Over here, with ProRealTime, we tend to blame ProRealTime (but justified), just because she is there as a party (entity). So the fact that things run server side, is a very special thing …
    So Yes, this is all thumbs up suddenly. But wait, things still don’t work well.

    #240926

    As #Peter points out again, the solution to a problem can be a very long path, especially when you have to get others to walk it.

    Hi druby – thank you for again a thoughtful post.

    It is difficult to respond to the individual questions, because it seems that most take the standpoint that the data can be found somewhere, and thus we can reconstruct from there.
    So let me try to explain what goes on (as how it all comes to me !) and what we have.

    First of all it is good to look at PRT as a large spreadsheet (think literal here, as in a spreadsheet being able to sum things from adjacent cells and all).
    This spreadsheet is fed with data, and the data never originates from PRT itself, unless it is user dedicated data such as your (set) time zone and more of this stuff.

    The data is always fed by the broker. Be that IB or be that IG (or Saxo and possibly more). Always. Thus whatever it is we see, it originates at the broker, and is presented by PRT through its own “filters”. Daily profit is taken from the broker (enormously complex in itself, as touched in my previous post) and this is done in time intervals (like once per 10 minutes or whatever). After that, it is the internal spreadsheet doing the work. If you have Tesla in your portfolio, then PRT knows what to accumulate from where, in order to arrive at the daily profit, or even portfolio amount. Until the data is re-obtained from the broker (and all should match 100% for a fraction of a second) after which the self-accumulating restarts. And so on.

    The statistics are NOT obtained from the broker. They are self-generated but with detail data from the broker.
    The list of orders, ditto.
    Commission is NOT obtained from the broker. And, I take IB as the example, because there Commission is in order. It is not obtained from the broker – IB – because it is not provided in their API.

    The profit we see on a chart, is a strange mix of what the broker tells and what PRT can add herself to it, throughout the day, and which is always without commission. Daily profit is a mess (per chart already) because of the settlement times – daily profit starts at the last settlement, like DAX last 17:30 (16:30 your time) if only the DAX was open at that time (like Good Friday it may not – whatever). An effect of this, is that if I gained 2000 yesterday (Friday) this profit will be shown still at Sunday’s (/Monday’s) opening of USA Futures, and the 2K gain will be incorporated in the daily profit. Until the DAX opens (01:15 my time these days) then suddenly that 2K is deducted.
    This is just what happens Live and in real life, and this is sufficiently obfuscating already. 🙂

    The list of orders is thus also a spreadsheet. These days it can contain 1000 orders (recently upgraded from 500) and it is a FiFo list (first in first out).
    You can add filters to the columns (one field which acts upon all the columns) and it will (very) nicely give you the orders of e.g. one Autotrading System (but have the column with the system name in there). All from Nasdaq ? just enter that as (part of the) instrument name and done. I use it quite some times per day, it works really great.
    But only on these last 1000 orders, and as you may have seen by now, in my case the first orders of the day may have “FiFo”d out in the afternoon already (maybe not today’s but surely yesterday’s).

    Thus such a list just contains 1000 lines (the spreadsheet is not larger) and it always contains everything of all instruments and systems. So no filter will help you to make it more.

    The Statistics are based on the very same thing. An internal list which was upgraded to 10000 full trades (from 1500 which it was until a year or so ago), which this can show your financials only from the last 10000 trades. One could attest that you should not perform so many trades, but here the children’s garten phenomenon comes into play, right ?
    So here too, no filter helps ? … wait … here it does ! (unless something changed when this was upgraded from 1500 to 10000).

    So Yes, you could pull a statistic for each of the … what ? … instruments ? equities ? … and have them all on screen. Eh … ALL ? (max is 10 anyway)
    What is ALL then ?
    You won’t get far because you won’t know them. Too many things going on, already for Autotrading, let alone the sauce of manual trading which you also apply (I’d say). And mind you, all is about the performance of your Systems, right ?

    The point remains : when something goes wrong with one of your systems, the statistics for that is destroyed, thus also the higher level for it (the instrument) is destroyed, and the highest level (your portfolio) is also destroyed.

    So what happens is that one way or another, you won’t get there. This is not only related to the 10000 max, but also to the individuals not “working” any more.
    And the data is nowhere else to be found.

    I was once told “then go to IB to sort things out !”. No, at IB’s this is not there either, unless you know their data(base) and are able to make queries for it. But this is quite undoable because what to do with real time queries which don’t exist. And fun : from of V12 we can look at the statistics in real time (per checkbox for it – updated each 1 minute or so) Yea, until something goes wrong and the statistic is worthless forever.
    This feels like GraHal’s first post : does PRT even know what they are making which for ? (my translation of it)

    But can you tell again what you would want this all for ? … let me get your start(l)ed :

    What you see below is a test run of one day. Statistic contains all (as far as I can tell) so nothing wrong there. What we sadly don’t see incorporated in the Commission. Yea, that one again. Well, it is sort of easy to see for the one system which ran there : 134 times 4.40 (2.20 per side as it still was the beginning of November – today it is 2.25). So instead of 1K profit it was 5K loss.
    So what to do with this again ?
    I can tell you, when this is observed live, you won’t have a clue of the outcome. We win some, we lose some (look at the start of it) and while we obviously know about the commission, you hope for the better. Until one massive DD occurs again and the testing is over (I did not show that, but envision that 1087.50 vaporized). Then you can cozily count your losses and arrive at 7K.

    And so as long as the commission is not incorporated, it is quite useless to be able to provide a better complete picture (which this example was to begin with).
    And oh, needless to say that this hidden loss of 6K is also (hidden) in the aggregated statistics. I-just-have-no-clue of performance results. All I can relatively reliably see is the portfolio amount. Which is, remember, obtained from the broker.


    Do notice please, that with PRT-IG is is a sort of other way around;
    There we have the PRT statistics quite fine (if we for now skip the errors which make the statistics fail), but appears your portfolio $ to be half of what the statistics tell you. Eh …

    Maybe we recall from a year or so ago (was it two ?) that I called IG to have their annual report explained, which they actually could not do well apart from guessing. “Part A will be about interest and Part B will probably be about Spread – not sure !”. And their report really contains such a Part A and part B – the spread already incorporated in your trades hence PRT statistics.
    In the end I could derive that the missing link was about interest indeed, which with IG is relatively high. But also : with IB we can see this deducted each day. With IG we don’t see this anywhere (or maybe things have changed ?). But anyway, this is a normal thing. It belongs.
    Interest is there for IB as well ? maybe not because not for (the real) Futures. So the interest would only be for equities (Tesla and such) and Forex. With IG it is also for the CFD derivatives. And this is painful. How painful ? well, if PRT statistics show 20K profit, reality will be maybe 12K or so. Of course this depends on overnight positions, but I have those and thus this is real life for me.

    This latter part is off topic of course, if we only recognize that with IG the “insight” is not really much better than with IB. But it depends on your trading fashion. Thus, have one trade per day and you won’t notice a thing regarding the offset between PRT statistics and your IB portfolio $. And the other way around : have 1000 trades per day with IG and you again won’t notice a difference between PRT statistics and portfolio $. Not even because of interest in that case (you probably wont be in overnight).

    Hopefully this helps some ?

    1 user thanked author for this post.
    #240937

    Many thanks to all for sharing gotchas  …..

    There’s a lot to be said about volume (noise) generation and how the backend firstly performs it’s FIFO (it’s ability under load) and then how it goes about reporting it.

    There’s so much CIC in all companies and a wish list for PRT rel.notes so us mortals can caveat system builds and match use expectations, makes for a steeper learning curve. As it stands all we have a release build dates under – Help – with no other feedback.

    I really do not like 3rd parties but PRT do have a good offering, the transparency and feedback (as read w/in these threads) is it’s biggest downside. I have absolutely no doubt they are peddling as fast as they can and with Germany now making CFDs more attractive a new wave of clients is likely to onboard with them – hope they’re prepared for this and more.

    In another thread I’ve read about lag, is this growing pains PRT-IB and the heat being generated as we conclude the business cycle or other nefarious activities. Just recently there was another Sub Cable cut that will be cause path issues in EU, so funneling more bits over already congested pathways. We saw it-finance drop behind what looks to be ddos mitigation along while back now and these kinds of activities will only increase. There’s only so deep an input queue can go before it starts to hurt and lag but that’s why ddos and cable cuts exist – to hinder and annoy us.

     

    https://subtelforum.com/category/cable-faults-maintenance/

     

    The system does not contain any “Bestens” (= Market) orders, but this happens (watch the times). This is about the (computer-)communication between PRT and IB. This is also about the complexity of synchronisation.

    So w/in code NO MKT orders but MKT executed alongside LMT – that’s what they call a ‘feature’ … /s

    My disappointment factor is growing and at times I feel it could be a bundle of system complexity and volume in terms of how aggressive you are running. You have been quite transparent regarding issues and I can only add that it would be nicer if you could have better ‘visibility’ but then that comes back to CIC or work’s in progress vs how the platform is engineered. It could well have limitation overhang in what it can – currently – return to us as IP. I reallyx2 like PRT but the gotchas/caveats are rippers when you take into account there ‘interop-status’ as a provider (based in forum feedback). I do feel though that it’d be better to NOT provide IP to the customer base unless that IP is spot on and no further interpretation is required, otherwise it’s a bad look imo.

     

     

    #241192

    Acording to funds available on the IG Dashboard, my Portfoio has increased 17% in the last few weeks (Demo! 🙁 ).

    I cannot – easily – find which few Systems have made the biggest difference, hence I raised this Topic.

    I decided to (again!) export the ‘Order List > Executed’ to Excel and pivot the data. I was perplexed to find that for 1 month worth of data, the overall combined Gains / Loss was negative.

    So looking further, despite having selected 1 month (see attached) there are very few rows for November and even 2 Dec (see attached).  You can see that from 4 Dec onwards there are multiple rows … as I would expect out of 98 Running Systems. If I change the Selection  to 1 year, nothing changes.

    When I exported 1 month worth of Executed Orders to a spreadsheet, it filled only 547 rows and so the data should not be limited by the 1000 Orders limit.

    I’m giving up for now … as I have on every other occasion when using export to excel (via csv file).  I’m posting this as otherwise it was a complete waste of a 1 hour + of my life.

    My only conclusion at this stage is – despite the ‘Period Selector’ stating 1,000 Order Limit – the Order limit appears to be very much closer to 500 (547 in my case) hence why attached shows loads of Orders from 4 Dec onwards (despite me selecting 1 month).

    Any useful thoughts or ideas most welcome.

    #241194

    I have 29 rows and a few pixels in my list as default on screen and could apply 24 times PgDn. That comes to 986. Mind you, this is one-side orders.
    But now watch out :
    For IG I can do the same, and what ? 464 one side orders (this is the 2nd attachment, showing the end as in the first attachment).

    And as told already, filtering that does not help because the list is the base to begin with (can only get less when filtered).

    I’m giving up for now …

    So, what are you going to do when this would be real-Live ? Swim in your money you can’t see ?

    #241200

    Since portfolio Order List allow system’s to be listed…

    I suppose analysing the data outside of PRT, and keeping a complete appended record, will require dumping a new .csv file at a frequency that all new data is included since last dump.

    Regardless of how data is used and with what, you can’t go back more than 1000 orders or what value it is, from any future point .

    So a systematic  dump of data would ensure historical data was collected,  if ‘with what’ materialises, then the data would be available in un processed form to process.

    Anyway, just updating my thoughts on the subject.

     

    In excel, did you combine the gain of each system, or just for all.

    #241201

    I am sorry Peter, but I don’t understand what you are saying? Ss1 and ss2 show 3 rows each, how do 3 rows relate to the 29 rows you mention.

    I tried hitting PgDwn whilst in the Orders List and it did not go any further than the bottom of the screen that I was looking at, i.e. repeatedly hitting PgDwn not not get me to the bottom of the Orders List.

    #241202

    did you combine the gain of each system

    Yes I did a Pivot Table showing Sum of Gain against each System and totalled up at the bottom (all the +’s added to all the -‘s).

    require dumping a new .csv file

    Yes I have tried this in the past, but it is so much faff and inevitably, due to other pulls on time, I never kept it up for any significant period.

    1 user thanked author for this post.
    #241204

    repeatedly hitting PgDwn not not get me to the bottom of the Orders List.

    I got it working now … I show 592 rows on my Detailed Report for a Portfolio of 98 Systems running in Demo with the Filtert set to 1 month.

    Typically I get around 250 Orders per day (512 Orders with Filter set to 2 days) hence why my export to excel did not produce much useful information for analysis.

    #241205

    I am sorry Peter, but I don’t understand what you are saying? Ss1 and ss2 show 3 rows each, how do 3 rows relate to the 29 rows you mention.

    What should they ?
    Here you have 29 rows. How does that help you ? It is about me showing the bottom of the list, in this case “beginning” at Nov. 14 which is worthless, but which is about 960 or whatever single side orders.
    Do notice that you can only see the date if you really click on the picture.
    Anyway, the 29 are coincidentally in my list (there is no use in making that 53 or whatever first on my screen, vertically – right ? Applying 34 times page down bring me to the end of the list. 29 x 34 is 984.
    Take a breath and swim ! 🙂

    One additional thing : you ask for the list in a slightly different view, which would not be my view because Real-Live. Apparently in your means of the list you can’t apply PgDn ? I think you can anyway, but give it the proper focus first and otherwise we apply click-in-scrollbar (34 times). Same thing.
    Anyway, see second SS. Now that is YOUR means – but with my real-Live data, may that matter. Click once in vertical the scroll bar and start to PgDn … it just works. For me this goes back to Oct 2023 – see 3rd SS. But this is tricky because these are the unfiltered Statistics (Detailed Report) from ONE instrument with system unknow (I also did not select Autotrading or Manual trading). I just gave that 60 times the PgDn and am still now-where, thus gave up. Probably there are 10000 full trades in there ? (yes, from Nasdaq only). That can well be. … Ah, of course this shows in the statistics themselves … 7054 full trades (not shown, but you will believe me).
    But this too I already told : the Detailed Report just can hold 10000 trades full trades, build from the ground. Now somewhere we must still be talking about different things.
    Can you envision another list with orders which is different from the two means I used today in this thread ?

    –> Yes, we also have the Detailed Report of the Portfolio. But that one is completely useless to me because a. it should tell ALL but b. it does not in the first place (because limited to 10000 full orders today). I can try to count that for you, but this is useless. What *is* useful is that a subset of your orders shows up in the Detailed Report of it, and it has NOT a base of 1000 or whatever orders. So, after asking for the Nasdaq I now asked for the S&P500. 6563 full trades in there. With the 7054 from Nasdaq that is more than 10000.

    This all summed up, I feel that the solution must be able to be in the asking for Detailed Reports – not the Orderlist (which can hold 1000 one-side trades only – 500 in IG as it seems).
    You do know that a Detailed Report for the whole Portfolio exists, right ? (the one rendered useless for me). –> Yes of course you do because you show that in your OP already.
    Now somewhere something is wrong, because I can literally do what you can not. As long as I would have less than 10000 full trades in there (I exceed that, but you may not).

    something is wrong something is wrong something is wrong

    ?

     

    PS: I seem to be confusing because I started to use that list which DOES show 1000 only (500 with IG ?) because you mentioned that 1000 (I think 😉 ). But then otoh I can not use the detailed report as well. So it *is* all very confusing !

    #241210

    Detailed Report of the Portfolio. But that one is completely useless to me

    Useless to all of us because the option to add – column System – is not available to us.
    Beats me why PRT cannot / do not see this or do not tell us why they cannot arrange for System to be an Option as a column??

    It is not for want of us Suggesting it to PRT … I have and I’m sure you have Peter?

    Anybody reading this, please send in a Suggestion direct to PRT asking for System to be added as an option column in the  Detailed Report of the Portfolio.

     

    #241211

    It is not for want of us Suggesting it to PRT … I have and I’m sure you have Peter?

    Yes I have. I think 18 months or so ago, after putting up a thread with explicit questions on how to improve ProOrder (remember ?). I passed on all what was suggested in that thread, with the notice that PRT first asked *me* (and so I asked all of you).
    All what came from that is the even more confusing top part of the ProOrder form with stopped orders which you can’t even restart from there.

    If I were you I’d skip my opportunistic hopes to V15. And then it may be in there because someone pressed a few wrong buttons, hence coincidental. And without Release Notes of course, so you would not even know it’s there.
    But let’s not get in that mood. It’s such a beautiful day !

    1 user thanked author for this post.
Viewing 12 posts - 16 through 27 (of 27 total)

Create your free account now and post your request to benefit from the help of the community
Register or Login