IPB

Welcome Guest ( Log In | Register )

 
Reply to this topicStart new topic
Designing a FOREX Trading System using SOFM and SVM
navyseal
post 4th May 2009 - 03:26
Post #1


Newbie
*

Group: Members
Posts: 5
Joined: 4-May 09
Member No.: 178



Hi Peltarion

i am trying to design a Simple 2-Stage Hybrid Intraday FOREX Trading System using SOFM and SVM . In the First Stage , the SOFM is used to cluster the training data sets into several disjointed Clusters (regions) probably 3 to 6 Clusters . In Second Stage, Mutiple SVMs (or SVR) are constructed for each Cluster in order to either Predict the Price or to classify a BUY or SELL

Inputs: O,H,L,C,V and may be 5 other relevant indicators (RSI, MACD, CCI, SMA, STOCH K ) = may be 10 inputs

Output: Option 1: Classify into BUY ( = 1) and SELL ( = 0)
Option 2: Predict the Price of the Pair e.g EURUSD

The System needs to be completely adaptive may be using SWAM or Genetic or Monte carlo Optimization

Please can someone get back to me and i will send you a document describing the system i am trying to adapt to Forex trading system. I have been trying to use Synapse to design the system but i am getting stuck since i am new to Synapse Software. Any help to do this. I have about 20 similar Hybrid Systems that i am planning to design using SYNAPSE software. If this first example proves to be easy to design i will Purchase the Software inorder to complete the remaining Advanced and complex Hybrid Systems.

Thank

Navyseal
Go to the top of the page
 
+Quote Post
luka
post 4th May 2009 - 07:16
Post #2


Peltarion
****

Group: Peltarion Team
Posts: 117
Joined: 10-September 08
Member No.: 4



Both SOMs and SVMs only work on static algorithms where no implicit time dependency exist between samples. They are essentially unsuitable for time series data.
Go to the top of the page
 
+Quote Post
navyseal
post 4th May 2009 - 13:47
Post #3


Newbie
*

Group: Members
Posts: 5
Joined: 4-May 09
Member No.: 178



QUOTE (luka @ 4th May 2009 - 07:16) *
Both SOMs and SVMs only work on static algorithms where no implicit time dependency exist between samples. They are essentially unsuitable for time series data.


It is kind a strange because my former employer the Largest Investment bank in the world uses exactly that with a system win rate of 95.5% and a drawdown of 2.7%. I was incharge of the trading Systems and i know what was programmed and i can duplicate it. In reality most people think that way .

If you can help i will appreciate it do not worry if it is suitable for time series or not
Go to the top of the page
 
+Quote Post
johnr
post 5th May 2009 - 06:24
Post #4


Newbie
*

Group: Members
Posts: 8
Joined: 29-September 08
Member No.: 20



I think what Luka is trying to say is that what you are asking for is mathematically impossible. Neither SOMs nor SVMs have any form of short-term memories. They have no way of remembering the order of past samples. It's not a question of suitability but a simple fact of the nature of the algorithms.
Go to the top of the page
 
+Quote Post
navyseal
post 5th May 2009 - 09:50
Post #5


Newbie
*

Group: Members
Posts: 5
Joined: 4-May 09
Member No.: 178



QUOTE (johnr @ 5th May 2009 - 06:24) *
I think what Luka is trying to say is that what you are asking for is mathematically impossible. Neither SOMs nor SVMs have any form of short-term memories. They have no way of remembering the order of past samples. It's not a question of suitability but a simple fact of the nature of the algorithms.


i do agree but it has been done. i know for a fact . I have several Private papers or instructions on doing it for Forex Trading which i used at the Commercial bank as a Senior Strategeist and Trader. They still use the same Hybrid structure i described and it is in 3 of their Major (Top) Systems. They really make the money with this system.

I thought Peltarion would make it easy to do it. I guess i will just have a Neural Network Programmer Code it for me. Most of the Programmers at the commercial bank Coded the Neural Network SOMs & SVMs hybrid system so i know for sure because i worked with them to code it.
Go to the top of the page
 
+Quote Post
luka
post 5th May 2009 - 11:53
Post #6


Peltarion
****

Group: Peltarion Team
Posts: 117
Joined: 10-September 08
Member No.: 4



Johnr is right. Self organizing maps and support vector machines don't see time dependencies in data. If you put a time series into a SOM or SVM, you'll get nonsense out as they are static algorithms. If you want to predict FOREX trading signals (there are quite a few Synapse users that use it for that purpose), you should use the dynamic algorithms/system in Synapse that range from Gamma networks to full blown LSTMs.

For an introduction to time series modeling in Synapse, see tutorial 3 (although I would recommend going through the two first tutorials before that).
Go to the top of the page
 
+Quote Post
navyseal
post 9th May 2009 - 21:05
Post #7


Newbie
*

Group: Members
Posts: 5
Joined: 4-May 09
Member No.: 178



QUOTE (luka @ 5th May 2009 - 11:53) *
Johnr is right. Self organizing maps and support vector machines don't see time dependencies in data. If you put a time series into a SOM or SVM, you'll get nonsense out as they are static algorithms. If you want to predict FOREX trading signals (there are quite a few Synapse users that use it for that purpose), you should use the dynamic algorithms/system in Synapse that range from Gamma networks to full blown LSTMs.

For an introduction to time series modeling in Synapse, see tutorial 3 (although I would recommend going through the two first tutorials before that).


Hello John & Luka,

What are the best Types of Neural Networks in Synapse to use to Build Forex Trading Systems . Just an honest recommendation would be great . Thank you . i am going through the Tutorials to get a good understanding how Synapse works

Thanks
Go to the top of the page
 
+Quote Post
navyseal
post 9th May 2009 - 22:11
Post #8


Newbie
*

Group: Members
Posts: 5
Joined: 4-May 09
Member No.: 178



Hello John or Luka,

Can someone please put up a simple tutorial on how to create a simple FOREX Trading System using Synapse.

Synapse Data Feed --> Synapse ---> Synapse DLL ( Which generates BUY or SELL signals) and then

How to integrate the Synapse DLL into a C# application with Realtime Data Feed

Realtime Data Feed (Data Feed Adapter) ----> Application with Synapse DLL ( e.g Generating Buy or Sell Signals on MT4) ---> Forex Brokers ( Signals are executed on Metatrader 4)

Just a Simple end to end example would be Great and helpful to the forum greatly. You can use Metatrader Data Feed which is Free and Great . I am actually using Metatrader 4 platform and so are millions of Retail professional system traders. This would be Great . Thank you very much

Go to the top of the page
 
+Quote Post
bansh33
post 3rd January 2010 - 09:03
Post #9


Newbie
*

Group: Members
Posts: 4
Joined: 3-January 10
Member No.: 322



QUOTE (johnr @ 5th May 2009 - 14:24) *
I think what Luka is trying to say is that what you are asking for is mathematically impossible. Neither SOMs nor SVMs have any form of short-term memories. They have no way of remembering the order of past samples. It's not a question of suitability but a simple fact of the nature of the algorithms.


Yes that is true. But I think you can still use SOFM/SVM for trading, if the features you pass into your model hold enough temporal information. Basically, you need to convert the dynamic prediction problem to kind of static pattern recognition problem. Which is VERY difficult.
There is a lot of material on how SVM is used to predict time series/ forex rate changes available on the internet - for instance, in the book I have they describe a GASVM model for predicting monthly exchange rate change and the success ratio is above 80% and this method is presented as the best one in the book (compared to other neural network based methods.)

So basically, there are two rules:
1) Features you select needs to be relevant to the market movements and hold enough temporal info to be noticed by the SVM...this is the hardest part, because if you pass too much non relevant features to SVM you get bull***t as an output...you could use some GA optimizer to select just relevant features
2) The task you use SVM for must be simple enough....you may need to use multiple SVMs to get enough info if to make BUY or SELL decision
3) Noise will be your worst enemy...you need to define you features and classes carefully to avoid noise as much as possible

Also, there are modifications to both SVM and SOFM to gain better performance for this type of operation (DSVM, c-ascending SVM, temporal SOMs), which might help you to gain some accuracy in addition (basically, all these methods works with dynamic cost factor - recent samples get higher C)

Good luck!
Go to the top of the page
 
+Quote Post
business-investm...
post 26th April 2010 - 06:35
Post #10


Newbie
*

Group: Members
Posts: 1
Joined: 26-April 10
From: usa
Member No.: 518



i tried to do in that way but couldn't succeed


--------------------
Go to the top of the page
 
+Quote Post
bansh33
post 25th May 2010 - 00:45
Post #11


Newbie
*

Group: Members
Posts: 4
Joined: 3-January 10
Member No.: 322



I think this is good reading for start:

"A two-stage architecture for stock price forecasting by integrating self-organizing map and support vector regression"
http://linkinghub.elsevier.com/retrieve/pi...957417408007860

I want to try this later too (now I stick with single/multiple SVR without using SOM)...

Edit: Also this one is interesting: http://www.svms.org/finance/Cao2003.pdf
Go to the top of the page
 
+Quote Post
Steve
post 28th May 2010 - 03:41
Post #12


Newbie
*

Group: Members
Posts: 3
Joined: 21-June 09
Member No.: 195



QUOTE (navyseal @ 5th May 2009 - 17:50) *
i do agree but it has been done. i know for a fact . I have several Private papers or instructions on doing it for Forex Trading which i used at the Commercial bank as a Senior Strategeist and Trader. They still use the same Hybrid structure i described and it is in 3 of their Major (Top) Systems. They really make the money with this system.

I thought Peltarion would make it easy to do it. I guess i will just have a Neural Network Programmer Code it for me. Most of the Programmers at the commercial bank Coded the Neural Network SOMs & SVMs hybrid system so i know for sure because i worked with them to code it.


Hi NavySeal - I note that this is an old thread - but did you ever get a resolution to your question?
I would like to explore your ideas with you, with a view to collaboration toward a working trading system.

I have been developing trading ideas using neural networks for over a year now - based on a time series analysis.
I've had extremely poor results & conclude that this is NOT THE WAY TO GO.

To predict FUTURE price or buy/sell points using a time series the network must be able to analyze a repeating pattern, and the pattern should repeat consistently into the future.
It does not work this way!
It is simply too random. (Certainly in today's markets)

My conclusion is that the best that one can do is to be reactive to changes in patterns - with some statistical analysis behind it - without unreliable future prediction on price action.
The more work I do leads me towards static pattern recognition / vector analysis with some statistical input.
Go to the top of the page
 
+Quote Post
svm
post 30th June 2010 - 15:44
Post #13


Newbie
*

Group: Members
Posts: 1
Joined: 30-June 10
Member No.: 602



QUOTE (Steve @ 28th May 2010 - 03:41) *
Hi NavySeal - I note that this is an old thread - but did you ever get a resolution to your question?
I would like to explore your ideas with you, with a view to collaboration toward a working trading system.

I have been developing trading ideas using neural networks for over a year now - based on a time series analysis.
I've had extremely poor results & conclude that this is NOT THE WAY TO GO.

To predict FUTURE price or buy/sell points using a time series the network must be able to analyze a repeating pattern, and the pattern should repeat consistently into the future.
It does not work this way!
It is simply too random. (Certainly in today's markets)

My conclusion is that the best that one can do is to be reactive to changes in patterns - with some statistical analysis behind it - without unreliable future prediction on price action.
The more work I do leads me towards static pattern recognition / vector analysis with some statistical input.


I've tried everything, som, LVQ, PNN and the results were poor, I have a week testing with SVM and I'm getting pretty good results, I think is the solution ..
Regards
Go to the top of the page
 
+Quote Post
bansh33
post 4th August 2010 - 05:52
Post #14


Newbie
*

Group: Members
Posts: 4
Joined: 3-January 10
Member No.: 322



QUOTE (svm @ 1st July 2010 - 00:44) *
I've tried everything, som, LVQ, PNN and the results were poor, I have a week testing with SVM and I'm getting pretty good results, I think is the solution ..
Regards


I am also experimenting with predicting time series behaviour using SVM (in regression mode), and preliminary results are interesting - it seems to be able to "see" certain price moves few bars ahead, also in the full out-of-sample data segment. The question is, if this performance is good enough to build a trading system of top of it - I don't know yet.

Look at the images - I try to predict percentual change of EMAH3 (exponential average of highest price, period 3) 5 bars ahead. Time series is EURUSD, timeframe 4H. SVM inputs and paramets are chosen by a genetic optimizer. There are three images attached for demonstration:

- training - used for SVM training, 1000 bars
- validation - used for validating the model (out-of-sample for SVM, but in-sample for genetic optimizer), 200 bars - used to select imputs and SVM parameters
- outofsample - full out-of sample data (not seen by any component of the system), 200 bars

Attached File(s)
Attached File  eurusd_training.png ( 77.51K ) Number of downloads: 22
Attached File  eurusd_validation.png ( 45.82K ) Number of downloads: 21
Attached File  eurusd_outofsample.png ( 44.01K ) Number of downloads: 22
 
Go to the top of the page
 
+Quote Post

Reply to this topicStart new topic

 



RSS Lo-Fi Version Time is now: 2010-09-06 17:50
Bridged By IpbWiki: Integration Of Invision Power Board and MediaWiki © GlobalSoft