May be i can take a hint?
Databese may be in raw format, but only what a need - trusted location of fields! This useful.
But im can`t take you method for transfer(im using ssl connection to ftp, and in network over VLAN...)
Maybe im dont understand you correctly, sorry.
And that:
maybe im can help you`rs for generalization to solve problem with some attacks.
I can use some times ago a cluster on 16xPentiumI with my system, and use clusterization of weigt of polls.
Weight is collecting discrets, discrets - simple episodes/categories of attacks. SOme attacks include methods of other attacks,
and for future time we have some stabilized clusters of types attacks and dont loose time needed for computing.
Of course, very need methods of resorting lists by priority! - this a separating topic. This all a recursia - this about using time (maybe 'recursia' word is wrong ? i`m dont have good dictonary).
I want to say more, but for me very hard to write.
But im say more, this:
Clusters, only clusters.
But no systems has correctly support space of integers/code (as a one element), and dont get instruments like a tree - as a element of element "cluster"(may be that can be to say differ?(about tree) dont understand how say this correct.)
At next. We have unified calculating tree, - and something need! - Contexts! Unified contexts! And this work.
And else, with simple correlator in kernel, job is more better. This take more information about clusterized systems (links of systems) and more objective data. And we can use this functions on reverse process (first - learn , second - teach

)
And a features, what has angry me, unusable, - intagers with fixed limits, his need to be have a place!! Grrrr! And some objects, translated in many
documents like ".c" !!! But if i cant know about than? - Grrrr! Something else... a.. im forgot. And archives of data, history,distribution - i solve this and some more on low level. - Im sure, this dont be give time of programmer!
And im, some time ago construct my system for that (space of code). At one i solve a problem with distribution of calculating on many machines on low level, and some fundamental problems too. Idea is take me that, be at ~1999-2000 year.
This system may be used on different ways, as example on self-learning protocols(electrical), and else im use this for library (for compress and deal fast searching words/contexts).....
Im hope, in near future im resort all what im have on this project and deal it free, maybe over GPL.
But ideas free forever

And if i can help somewho - im be very happy.
P.S.
Sorry, may-be im deal some flood?