I couldn't seem to find this as an idea or discussion but apologies if I've missed a post.
I'm looking to update a SQL table daily with new data. Obviously an Append would do this job if the data to be added was always only new data.
The problem comes when some values from previous days have been corrected or updated and these also need pushing to the same database.
I have a solution that compares the last few days data (from the database) with the same number of days from the source and if it's new it Appends, if it's corrected it Updates. The solution is adequate if a bit slow for large data sets as it appears to publish line by line and requires the last few days from the database to be pulled back into the Omniscope process.
My idea/suggestion would be to include another option in the Database output block that uses the Merge command. If anyone else has solutions for this that work better please let me know. Not sure if this is possible or even has enough people wanting it?
Another solution might be simply to allow custom SQL in the database output block, similar to the input blocks. Then users could write their own code to cover any conceivable use case.