I am VERY experienced with parsing data. I also know more than enough about SQL to complete this project. My method, would be to have a universal file handler that each thread can access (with locks of course to prevent errors), and read the next line from, and then process, based on the format of the sql database/table, and the format of the text file. The only thing i don't yet understand, is how you would like the text files the program is parsing to be formatted, for example, some would use comma separated values, which i find most efficient for this scenario, example:
database table:
item1 item2 item3 item4 item5
file format:
item1,item2,item3,item4,item5
item1,item2,item3,item4,item5
... etc
please send me a pm with further details on the format, other than that, i can provide a working solution within 1 day