Class AnyToAnyImporter
java.lang.Object
net.sf.basedb.core.plugin.AbstractPlugin
net.sf.basedb.plugins.AbstractFlatFileImporter
net.sf.basedb.plugins.batchimport.AnyToAnyImporter
- All Implemented Interfaces:
AutoDetectingImporter
,InteractivePlugin
,Plugin
,SignalTarget
,ConfigureByExample
public class AnyToAnyImporter
extends AbstractFlatFileImporter
implements InteractivePlugin, ConfigureByExample
Plug-in for importing any-to-any links from simple text files. The plug-in supports
all files that can be parsed with the
FlatFileParser
class. This plug-in
works without a configuration but can use a configuration to store regular
expressions and other settings for the flat file parser. In both cases,
the job configuration is a two-step process:
- Setup regular expressions and other options for the flat file parser. If a configuration is used all values should already be filled in. In this step a file to import from must also be selected.
- Setup error handling options and other settings for the plug-in.
- Version:
- 3.17
- Author:
- nicklas
-
Nested Class Summary
Nested classes/interfaces inherited from interface net.sf.basedb.core.plugin.Plugin
Plugin.MainType
-
Field Summary
Modifier and TypeFieldDescriptionprivate Project
private static final String
private RequestInformation
private RequestInformation
private boolean
private DbControl
private Mapper
private boolean
private boolean
private boolean
private boolean
private boolean
private boolean
private boolean
private FlatFileParser
private static Set<GuiContext>
private static final PluginParameter<String>
private static final PluginParameter<String>
private Mapper
private IdMethod
private ItemList
private static final PluginParameter<String>
private ItemQuery<?>
private Item
protected static final PluginParameter<String>
private static final PluginParameter<String>
private Mapper
private static final PluginParameter<String>
private static final PluginParameter<String>
private static final PluginParameter<String>
private static final PluginParameter<String>
private int
private int
private int
private int
private static final BooleanParameterType
private static final StringParameterType
private boolean
private static final StringParameterType
private Mapper
private static final PluginParameter<String>
private static final PluginParameter<String>
private static final PluginParameter<String>
private Mapper
private boolean
Fields inherited from class net.sf.basedb.plugins.AbstractFlatFileImporter
complexMappings, dataFooterRegexpParameter, dataHeaderRegexpParameter, dataSplitterRegexpParameter, defaultErrorParameter, errorSection, excelSheetParameter, fileParameter, fileType, headerRegexpParameter, ignoreRegexpParameter, invalidUseOfNullErrorParameter, mappingSection, maxDataColumnsParameter, minDataColumnsParameter, numberFormatErrorParameter, numberOutOfRangeErrorParameter, numDataColumnsType, optionalRegexpType, parserSection, requiredRegexpType, sectionRegexpParameter, stringTooLongErrorParameter, trimQuotesParameter
Fields inherited from class net.sf.basedb.core.plugin.AbstractPlugin
annotationSection, configuration, COPY_ANNOTATIONS, job, OVERWRITE_ANNOTATIONS, sc
-
Constructor Summary
-
Method Summary
Modifier and TypeMethodDescriptionprotected void
begin
(FlatFileParser ffp) Setup error handling and pre-load some of the configuration options.protected void
Setup column mapping.void
configure
(GuiContext context, Request request, Response response) Configure the plugin.private ItemQuery<?>
createQuery
(Item itemType, ItemList list) Create a query that return items of the specified type.protected void
end
(boolean success) Called just after the last line of the file has been parsed, or immediately after an error has ocurred.private BasicItem
findTargetItem
(String targetId, String targetType, FlatFileParser.Data data) protected RequestInformation
getConfigureOptionsParameters
(GuiContext context) private RequestInformation
getConfigureParserParameters
(GuiContext context, boolean forJob) This plug-in works in list context of allNameable
items, except bioassay sets, bioassays and wells because they are not standalone items.protected IdMethod
getIdMethod
(DbControl dc, Item item, String method) getIdMethods
(DbControl dc, Item item) private ItemList
getItemListFromContext
(DbControl dc, GuiContext context) If the current context is the "Members" tab for an item list we load the item list and will later require that all items to be linked are members of that list.getRequestInformation
(GuiContext context, String command) This method will return theRequestInformation
for a given command, i.e.protected String
getSuccessMessage
(int skippedLines) Called if the parsing was successful to let the subclass generate a simple message that is sent back to the core and user interface.protected void
Called by the parser for every line in the file that is a data line.private boolean
hasExternalId
(Item item) Check if the current item has an 'externalId' property.isInContext
(GuiContext context, Object item) Check if the plugin can be used on the specified object.boolean
Return TRUE, since the implementation requires it for finding the regular expressions used by theFlatFileParser
.boolean
Returns TRUE, since that is how the plugins used to work before this method was introduced.Methods inherited from class net.sf.basedb.plugins.AbstractFlatFileImporter
addErrorHandler, checkColumnMapping, checkColumnMapping, continueWithNextFileAfterError, doImport, finish, getCharset, getCharset, getDateFormatter, getDecimalSeparator, getErrorHandler, getErrorOption, getFileIterator, getInitializedFlatFileParser, getInitializedFlatFileParser, getMainType, getMapper, getMapper, getNumberFormat, getNumBytes, getPattern, getPattern, getProgress, getSignalHandler, getTimestampFormatter, getTotalFileSize, handleHeader, handleSection, isImportable, isImportable, log, log, log, log, run, setUpErrorHandling, start, wrapInputStream
Methods inherited from class net.sf.basedb.core.plugin.AbstractPlugin
cloneParameterWithDefaultValue, closeLogFile, createLogFile, done, getCopyAnnotationsParmeter, getCurrentConfiguration, getCurrentJob, getJobOrConfigurationValue, getOverwriteAnnotationsParameters, getPermissions, init, isLogging, log, log, storeValue, storeValue, storeValues, validateRequestParameters
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
Methods inherited from interface net.sf.basedb.core.plugin.Plugin
done, getMainType, getPermissions, init, run
-
Field Details
-
guiContexts
-
CONFIGURE_OPTIONS
- See Also:
-
optionalColumnMapping
-
requiredColumnMapping
-
optionalBooleanType
-
identificationSection
-
idColumnMapping
-
linkNameColumnMapping
-
targetItemTypeColumnMapping
-
targetItemIdColumnMapping
-
linkDescriptionColumnMapping
-
itemNotFoundErrorParameter
-
multipleItemsFoundErrorParameter
-
targetNotFoundErrorParameter
-
multipleTargetsFoundErrorParameter
-
noWritePermissionToItemErrorParameter
-
noUsePermissionToTargetErrorParameter
-
dc
-
activeProject
-
ffp
-
itemType
-
idMethod
-
createMode
private boolean createMode -
updateMode
private boolean updateMode -
removeMode
private boolean removeMode -
includes
-
itemQuery
-
itemList
-
targetItemQueries
-
idMapper
-
linkNameMapper
-
targetTypeMapper
-
targetIdMapper
-
descriptionMapper
-
dryRun
private boolean dryRun -
failIfNotFoundSource
private boolean failIfNotFoundSource -
failIfMultipleSourceItems
private boolean failIfMultipleSourceItems -
failIfNotFoundTarget
private boolean failIfNotFoundTarget -
failIfMultipleFoundTargets
private boolean failIfMultipleFoundTargets -
failIfNoWritePermissionToSource
private boolean failIfNoWritePermissionToSource -
failIfNoUsePermissionToTarget
private boolean failIfNoUsePermissionToTarget -
numCreated
private int numCreated -
numUpdated
private int numUpdated -
numRemoved
private int numRemoved -
numSkipped
private int numSkipped -
configureParser
-
configureOptions
-
-
Constructor Details
-
AnyToAnyImporter
public AnyToAnyImporter()
-
-
Method Details
-
requiresConfiguration
public boolean requiresConfiguration()Description copied from class:AbstractFlatFileImporter
Return TRUE, since the implementation requires it for finding the regular expressions used by theFlatFileParser
. If this method is overridden and returns FALSE, the subclass must also override theAbstractFlatFileImporter.getInitializedFlatFileParser()
method and provide a parser with all regular expressions and other options set.- Specified by:
requiresConfiguration
in interfacePlugin
- Overrides:
requiresConfiguration
in classAbstractFlatFileImporter
- Returns:
- TRUE or FALSE
-
supportsConfigurations
public boolean supportsConfigurations()Description copied from class:AbstractPlugin
Returns TRUE, since that is how the plugins used to work before this method was introduced.- Specified by:
supportsConfigurations
in interfacePlugin
- Overrides:
supportsConfigurations
in classAbstractPlugin
- Returns:
- TRUE or FALSE
-
getGuiContexts
This plug-in works in list context of allNameable
items, except bioassay sets, bioassays and wells because they are not standalone items. We useMetadata.getAnnotatableItems()
to create the contexts.- Specified by:
getGuiContexts
in interfaceInteractivePlugin
- Returns:
- A
Set
containingItem
:s, or null if the plugin is not concerned about items
-
isInContext
Description copied from interface:InteractivePlugin
Check if the plugin can be used on the specified object. The item is either aBasicItem
orBasicData
object, or null if called from a list context. A client application should only call this method for contexts matching one of the contexts in the set returned by theInteractivePlugin.getGuiContexts()
method. ForGuiContext.Type.ITEM
contexts an item of the correct type should be passed as a parameter.The plug-in can response with a null value indicating success, a warning-level message or throw an exception to indicate an error-level message. Client application should normally only show error-level messages to users, unless the user has requested to see warning messages.
NOTE! Before BASE 2.4 all messages were treated as error-level messages.
- Specified by:
isInContext
in interfaceInteractivePlugin
- Parameters:
context
- The current context of the client application, it is one of the values found in set returned byInteractivePlugin.getGuiContexts()
item
- The currently active item, it's type should match theGuiContext.getItem()
type, or null if the context is a list context- Returns:
Null
if the plugin can use that item, or a warning-level message explaining why the plugin can't be used
-
getRequestInformation
public RequestInformation getRequestInformation(GuiContext context, String command) throws BaseException Description copied from interface:InteractivePlugin
This method will return theRequestInformation
for a given command, i.e. the list of parameters and some nice help text.- Specified by:
getRequestInformation
in interfaceInteractivePlugin
- Parameters:
context
- The current context of the client application, it is one of the values found in set returned byInteractivePlugin.getGuiContexts()
command
- The command- Returns:
- The
RequestInformation
for the command - Throws:
BaseException
- if there is an error
-
configure
Description copied from interface:InteractivePlugin
Configure the plugin. Hopefully the client is supplying values for the parameters specified byInteractivePlugin.getRequestInformation(GuiContext, String)
.- Specified by:
configure
in interfaceInteractivePlugin
- Parameters:
context
- The current context of the client application, it is one of the values found in set returned byInteractivePlugin.getGuiContexts()
request
- Request object with the command and parametersresponse
- Response object in for the plugin to response through
-
begin
Setup error handling and pre-load some of the configuration options.- Overrides:
begin
in classAbstractFlatFileImporter
- See Also:
-
beginData
protected void beginData()Setup column mapping. Creates DbControl and query to find items.- Overrides:
beginData
in classAbstractFlatFileImporter
-
handleData
Description copied from class:AbstractFlatFileImporter
Called by the parser for every line in the file that is a data line.- Specified by:
handleData
in classAbstractFlatFileImporter
-
findTargetItem
-
end
protected void end(boolean success) Description copied from class:AbstractFlatFileImporter
Called just after the last line of the file has been parsed, or immediately after an error has ocurred. A subclass should clean up any resources aquired in theAbstractFlatFileImporter.begin(FlatFileParser)
method here. Note that this metod is called once for every file returned by theAbstractFlatFileImporter.getFileIterator()
iterator.- Overrides:
end
in classAbstractFlatFileImporter
- Parameters:
success
- TRUE if the file was parsed successfully, FALSE otherwise- See Also:
-
getSuccessMessage
Description copied from class:AbstractFlatFileImporter
Called if the parsing was successful to let the subclass generate a simple message that is sent back to the core and user interface. An example message might by:178 reporters imported successfully
. The default implementation always return null. Note that this method is called once for every file returned byAbstractFlatFileImporter.getFileIterator()
.- Overrides:
getSuccessMessage
in classAbstractFlatFileImporter
- Parameters:
skippedLines
- The number of data lines that were skipped due to errors
-
getConfigureParserParameters
-
getConfigureOptionsParameters
-
getIdMethods
-
hasExternalId
Check if the current item has an 'externalId' property. We use reflection to look for the 'getExternalId' method in the item's data class. -
getIdMethod
-
createQuery
Create a query that return items of the specified type. We use reflection to call the static method 'getQuery' on the item's item class, for exampleSample.getQuery()
.- Parameters:
itemType
- The type of items to search- Returns:
- A query that searches items of the specified type.
-
getItemListFromContext
If the current context is the "Members" tab for an item list we load the item list and will later require that all items to be linked are members of that list.
-