Qore FixedLengthUtil Module Reference  1.5
FixedLengthUtil::FixedLengthDataIterator Class Reference

Structured line iterator for fixed-length line strings allowing efficient "pipelined" processing. More...

Inheritance diagram for FixedLengthUtil::FixedLengthDataIterator:

Public Member Functions

 constructor (string data, hash< auto > spec, __7_ hash< auto > opts)
 Instantiates the FixedLengthDataIterator object. More...
 
- Public Member Functions inherited from FixedLengthUtil::FixedLengthAbstractIterator
bool checkTransition (__7_ string from, __7_ string to)
 A verification function to be called for each line. This method can be overridden to achieve a begin-to-end validation of the whole input file. More...
 
 constructor (AbstractLineIterator li, hash< auto > spec, __7_ hash< auto > opts)
 Instantiates the FixedLengthAbstractIterator object. More...
 
__7_ hash< auto > getValue ()
 Returns the current record as a hash. More...
 
bool identifyRecord (list< auto > rec_rule, string input_line)
 Attempts to identify a single record.
 
string identifyType (string input_line)
 Identify a fixed-length line type using identifyTypeImpl(), that may be overridden if necessary. More...
 
__7_ string identifyTypeImpl (string input_line)
 Identify a fixed-length line type, given the raw line string. This method performs a lookup to a precalculated table based on line lengths (see constructor()). In case different criteria are needed, eg. when two line types in a spec have the same length and no unique resolving rule are specified, this method needs to be overridden, and will throw an exception, because the precalculated mapping will be empty. More...
 
bool next ()
 Moves the current line / record position to the next line / record; returns False if there are no more lines to iterate. More...
 
auto transform (auto value, hash< auto > type)
 parses the input value based on global configuration and the current field definition
 
- Public Member Functions inherited from FixedLengthUtil::FixedLengthBase
 constructor (hash< auto > m_specs, __7_ hash< auto > m_opts)
 Creates the object from the record specifications.
 
__7_ hash< string, AbstractDataField > getRecordType ()
 Returns the description of the record type, if any.
 

Additional Inherited Members

- Static Protected Member Functions inherited from FixedLengthUtil::FixedLengthAbstractIterator
static __7_ hash< auto > checkOptions (__7_ hash< auto > opts)
 Validate and prepare global fixed-length options. More...
 
- Protected Attributes inherited from FixedLengthUtil::FixedLengthAbstractIterator
hash m_resolve_by_length
 hash of type without rule, i.e.potentially conflicting records; key = record length, value = list of no-rule type names
 
- Protected Attributes inherited from FixedLengthUtil::FixedLengthBase
const GlobalOptionMap
 Translates from global options to data provider options.
 
__7_ hash< auto > m_opts
 Global input or output options.
 
hash< auto > m_specs
 The record specifications.
 

Detailed Description

Structured line iterator for fixed-length line strings allowing efficient "pipelined" processing.

Example:
string data = "00001AV\n00002BN\00003CZ\n";
hash<auto> specs = {
"type1": {
"col1": {"length": 5, "type": "int"},
"col2": {"length": 2, "type": "string"},
},
"type2": {
"col3": {"length": 1, "type": "string"},
"col4": {"length": 3, "type": "string"},
"col5": {"length": 8, "type": "date", "format": "DDMMYYYY", "timezone": "Europe/Prague"},
},
};
hash<auto> global_options = {
"encoding" : "UTF-8",
"eol" : "\n",
"ignore_empty": True,
"timezone" : "Europe/Prague", # used if not overridden in a date field specification
};
FixedLengthDataIterator i(data, specs, global_options);
while (i.next()) {
operation_with_hash(i.getValue())
}
See also
  • FixedLengthIterator for a stream-based class providing the same functionality as this class in a more generic way

Member Function Documentation

◆ constructor()

FixedLengthUtil::FixedLengthDataIterator::constructor ( string  data,
hash< auto >  spec,
__7_ hash< auto >  opts 
)
inline

Instantiates the FixedLengthDataIterator object.

Example:
hash<auto> specs = {
"type1": {
"col1": {"length": 5, "type": "int"},
"col2": {"length": 2, "type": "string"},
},
"type2": {
"col3": {"length": 1, "type": "string"},
"col4": {"length": 3, "type": "string"},
"col5": {"length": 8, "type": "date", "format": "DDMMYYYY", "timezone": "Europe/Prague"},
},
};
hash<auto> global_options = {
"encoding" : "UTF-8",
"eol" : "\n",
"ignore_empty": True,
"timezone" : "Europe/Prague", # used if not overridden in a date field specification
};
FixedLengthDataIterator i(string, specs, global_options);
while (i.next()) {
operation_with_hash(i.getValue())
}
Parameters
dataThe input string to process
specFixed-length line specification; see Specification Hash for more information
optsGlobal options; see Global Options for valid values