The time "Running queries for ruby" increased by syntax_suggest

[nobu]

Recently, ruby master incorporated syntax_suggest, then the time "Running queries for ruby" increased one hour.
Before that commit, it was about a quarter-hour.

[32/32 eval 16m4s] Evaluation done; writing results to codeql/ruby-queries/queries/security/cwe-1333/ReDoS.bqrs.

But now it is plus an hour.

[32/32 eval 75m46s] Evaluation done; writing results to codeql/ruby-queries/queries/security/cwe-1333/ReDoS.bqrs.

From the metric data, the difference of total lines doesn't seem significant, comparing with the above times.

Before

Metric	Value
Total lines of Ruby code in the database	1240764
Total Lines of user written Ruby code in the database	1232069
Total number of files that were extracted with errors	29
Total number of files that were extracted without error	7914

After

Metric	Value
Total lines of Ruby code in the database	1242280
Total Lines of user written Ruby code in the database	1233585
Total number of files that were extracted with errors	29
Total number of files that were extracted without error	7940

Any suggestions are appreciated.
Thanks in advance.

[nickrolfe]

Hi @nobu, thanks for bringing this to our attention.

I am able to reproduce the performance problem running our queries against your master branch. We will investigate and aim to fix this.

[aibaars]

@Noby as a temporary workaround you could try adding the following snippet to .github/codeql/codeql-config.yml. That should make CodeQL ignore the new folder.

paths-ignore:
  - lib/syntax_suggest

See also: Specifying directories to scan

[nobu]

Thank you for the info.
Applied it now.

[aibaars]

@nobu I'm happy to see that it worked for you. Note that the next version of CodeQL 2.10.5 should have a fix for this problem, so you might want to revert the workaround in a week or two.

[nobu]

Thank you, reverted the filter as all instances seem updated.

[aibaars]

Great! Thanks for confirming.