can somebody tell me why the ready tools are so fast? how they make their code so fast?
ok, let me explain more: I am trying to do some natural language processing on webpage texts. I am using OPEN NLP tool as base, and I add some small functions to it in order to improve. There is also some tools that do that, like Reverb, which is also built on the top of OPEN NLP. now, the interesting thing is that when I run my program; or only the basic part which is pure OPEN NLP, it takes longer than Reverb!!! Although Reverb is built on the top of OPEN NLP. So I am guessing they are doing something in Reverb to make every thing faster. I want to know what are those tricks? how can I make my code as fast as them?
Are you sure that Reverb uses parsing routines from OpenNLP and not from Guava?
posted 6 years ago
well they say Reverb is built on the top of OPEN NLP; this snippet is copied from Reverb website:
"ReVerb uses the following code and data, which are included in the release:
OpenNLP, including trained models
A subset of pages from Wikipedia"
So there, it even uses the models from OPENNLP(which take alot of time to load), but it is still faster than OPENNLP. back to my question, I know one way to increase the execution time is to convert the data into binary, and then run the process on binary data. But any other Idea other than this?
beside that I need it, I am really curious to know more about this.
For my next trick, I'll need the help of a tiny ad ...