Cycle 27 (v2 cycle #8), day Off:
I fix the crash that I did report in last journal entry. I have a new feature that I have introduced in last build that simply just don't work. I have added some traces to have more insight into that. I suspect that the problem is very simple but I simply don't see it.
My bare-metal server is ready but this morning, there has been a flash crash in crypto which made my system trade like crazy.
and it did crash again. It doesn't seem to be the same problem than the previous one. I'm not sure exactly what it is but I am feeling stressed about the whole situation. There are a lot reasons for that.
When my system is crashing, I need to unwind manually all the open positions back to the origin accounts. Just that is not trivial because the system generates a web of trades from multiple concurrent threads. Figuring which fund belongs to which account is complex task and a bit painful This need to be done fast because by leaving funds in intermediary currencies, I run the risk of losing money. Sometimes it can do the opposite but since the trade hasn't been made with a long investment horizon in mind, it is a risk.
Next, I have just thrown the towel in checking all the logs. Just this morning 30MB of logs have been generated. I think that I have a fear of losing control but I need to let go. The system generates too much logs to be manageable.
So to summarize,
I have a crash to understand and fix
Positions to unwind
and I have a server that is waiting to be setup once my trading system is able to run smoothly for some time so that I can do that.
I should be happy to see all those things happening. I remember last summer when I was worried because there wasn't much trading activity. Now, I'm in the exact situation. There is too much to handle and everything is happening all at once...
I'll take a long breath, try to stay calm. Manage one thing at a time and most important let it go. Accept that reviewing everything is not possible anymore.
Update:
I think that I have fixed the problem with the new feature and I have found the cause of my crash and I have added several small improvements that I have found while investigating.
I did restart my system. Crypto markets did experience another important drop and my system started to trade like a maniac and it did crash again on some other new bug...
ah....
to be fair with my work, I have to say that the problem seems to be caused by the exchange server that behave erratically under heavy load... So I get reactions that my system did never experience. This is good, it is going increase its robustness...
I fix the crash that I did report in last journal entry. I have a new feature that I have introduced in last build that simply just don't work. I have added some traces to have more insight into that. I suspect that the problem is very simple but I simply don't see it.
My bare-metal server is ready but this morning, there has been a flash crash in crypto which made my system trade like crazy.
and it did crash again. It doesn't seem to be the same problem than the previous one. I'm not sure exactly what it is but I am feeling stressed about the whole situation. There are a lot reasons for that.
When my system is crashing, I need to unwind manually all the open positions back to the origin accounts. Just that is not trivial because the system generates a web of trades from multiple concurrent threads. Figuring which fund belongs to which account is complex task and a bit painful This need to be done fast because by leaving funds in intermediary currencies, I run the risk of losing money. Sometimes it can do the opposite but since the trade hasn't been made with a long investment horizon in mind, it is a risk.
Next, I have just thrown the towel in checking all the logs. Just this morning 30MB of logs have been generated. I think that I have a fear of losing control but I need to let go. The system generates too much logs to be manageable.
So to summarize,
I have a crash to understand and fix
Positions to unwind
and I have a server that is waiting to be setup once my trading system is able to run smoothly for some time so that I can do that.
I should be happy to see all those things happening. I remember last summer when I was worried because there wasn't much trading activity. Now, I'm in the exact situation. There is too much to handle and everything is happening all at once...
I'll take a long breath, try to stay calm. Manage one thing at a time and most important let it go. Accept that reviewing everything is not possible anymore.
Update:
I think that I have fixed the problem with the new feature and I have found the cause of my crash and I have added several small improvements that I have found while investigating.
I did restart my system. Crypto markets did experience another important drop and my system started to trade like a maniac and it did crash again on some other new bug...
ah....
to be fair with my work, I have to say that the problem seems to be caused by the exchange server that behave erratically under heavy load... So I get reactions that my system did never experience. This is good, it is going increase its robustness...
