Opened 15 years ago

Last modified 15 years ago

#1238 closed task

Check performance of BioAssaySetExporter — at Version 2

Reported by: Nicklas Nordborg Owned by: everyone
Priority: critical Milestone: BASE 2.11
Component: coreplugins Version:
Keywords: Cc:

Description (last modified by Nicklas Nordborg)

This is slightly related to #1237 and may be caused by the same thing that is causing #903.

Change History (2)

comment:1 by Nicklas Nordborg, 15 years ago

Description: modified (diff)

comment:2 by Nicklas Nordborg, 15 years ago

Description: modified (diff)

Initial tests seems to indicate that the main factor is the number of selected fields. On the standard 'roles' test data set (4 assays, 35912 spots each) I get:

  • ~10 seconds for both serial and matrix formats if ch1+ch2+externalId is selected, the setting for "merge on reporter" doesn't affect the result
  • ~70 seconds for MeV format.
  • ~70 seconds for both serial and matrix format if ch1+ch2+all reporter fields are selected.
  • ~30 seconds if ch1+ch2+about half of the reporter fields are selected.

This is just an indication. More tests with larger data sets are required. There may be other factors as well that doesn't show up until the data sets grow larger.

Note: See TracTickets for help on using tickets.