You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I wonder what use case you have in mind for the fileContents column?
Because OpenRefine isn't great at storing longer texts in cells, it has the tendency to make the table a lot less compact.
The fact that only the beginning of the text is stored also restricts the potential uses we can make of it.
For those reasons I would be tempted to remove it, either completely or just by default, with an option to enable it if needed (which could also be the occasion to configure the maximum length of the contents stored in it, making the feature potentially more useful).
The text was updated successfully, but these errors were encountered:
I tested the extension loading a folder with many large XML files (10 files, each 500MB in size), and OpenRefine crashed with java.lang.OutOfMemoryError: Java heap space. When I tested it again with smaller XML files, it worked, and the content of each XML was loaded into the FileContent column.
I wonder what use case you have in mind for the
fileContents
column?Because OpenRefine isn't great at storing longer texts in cells, it has the tendency to make the table a lot less compact.
The fact that only the beginning of the text is stored also restricts the potential uses we can make of it.
For those reasons I would be tempted to remove it, either completely or just by default, with an option to enable it if needed (which could also be the occasion to configure the maximum length of the contents stored in it, making the feature potentially more useful).
The text was updated successfully, but these errors were encountered: