Export issue

atanskiy's profile image atanskiy posted 1 month ago in Import/Export Permalink

Hey, I came across an issue with exporting data from export grid rows.

Unfortunately, I need to export large datasets, it can get 4,5M per 3 days and I paid attention it works really slowly in comparison with SQL Server (SQL Server saves data in csv files quickly, but I have no ability to use it for running on the database).

Is there any solution or can something be done? I don't have permissions to write it straight into a file from the query.

Thanks in advance.

ansgar's profile image ansgar posted 1 month ago Permalink

Is it possible to get an SQL export of the table?

atanskiy's profile image atanskiy posted 1 month ago Permalink

not really...There are like 10 tables joined and after running the query I need to save the results. I get the results super quickly, like I see 20M of records within 3-4 minutes, but the application does struggles to save it...I'm trying to save files for every day with 1-1.5M of records and it also takes like around 10 mins each...It takes like half a minute in SQL Server, to save such data. Can anything be done?

ansgar's profile image ansgar posted 1 month ago Permalink

I cannot do much without knowing more about the structure and at least some example data rows.

ansgar's profile image ansgar posted 1 month ago Permalink

What's the type and version of your database server?

Probably you are experiencing the same as in issue #1293

atanskiy's profile image atanskiy posted 1 month ago Permalink

Hey, unfortunately, I can't give you a sample of data as it is at work... So the version of Heidisql is 12.8.0.6908, it is run on mysql When I try to save daily data 1.2-1.7M rows, it takes 8-10 mins to do so

atanskiy's profile image atanskiy posted 1 month ago Permalink

By saving, I mean, of course exporting all the rows into a csv file

ansgar's profile image ansgar posted 1 month ago Permalink

Ok so we're talking about MySQL, not MS SQL, so forget about issue #1293. I was unsure as you were talking about "SQL Server".

As said, I cannot do much without knowing the underlying table structure.

If we're talking about 20 mio rows or more, it's probably normal it takes a longer time.

Please login to leave a reply, or register at first.