What you can do to do is run DatabaseRetrieve and find out last used id. Then copy part of your file starting with a new id into a new (temp) file and load that file instead of the original file. Or you can load the entire file into a temp table and than execute INSERT..SELECT statement in the database to copy portion of thta temp table into the main one. This all very doable. 24x7 supports a number of file operations for working with text files. : Ok, the DatabasePipe method works, but I still have some problems with : duplicates. : My problem is that I have a program which generates a logfile (csv format). I : want 24x7 to transfer this logfile to a mysql-database on a 24 hour basis. : When this job runs i don't want it to import the whole csv-file all over : again, but only the records whose id is above the last record in the : database... Understand? : I've tried playing with the SQL statement in the databasepipe code, but no : luck so far, just a bunch of error messages. : Have a tip for how I should avoid duplicates? : Thanks! : /Henrik
|