class SeqDataSet

This class defines the standard framework of Sequence Data processing

Inheritance:


Public Fields

[more]SeqExample* examples
the vector of examples of the dataset
[more]char** file_names
names of data files
[more]int n_file_names
the number of data files to read
[more]bool norm_inputs
do we normalize the inputs?
[more]bool norm_observations
do we normalize the observations?
[more]real* mean_in
if we normalize the inputs, this vector contains the mean of the inputs
[more]real* mean_ob
if we normalize the inputs, this vector contains the mean of the observations
[more]real* stdv_in
if we normalize the inputs, this vector contains the stdev of the inputs
[more]real* stdv_ob
if we normalize the inputs, this vector contains the stdev of the observations
[more]int current_frame
the current frame we are working on
[more]int n_frames
the number of frames of the current example
[more]int n_observations
the number of observations of the examples
[more]int tot_n_frames
the total number of frames in the dataset
[more]char* kind
some dataset keeps an information of the kind of the data.
[more]int n_seqtargets
if there are targets, the length of the seqtargets matrix.
[more]real** seqtargets
the targets of the current example

Public Methods

[more]virtual void freeMemory() = 0
each Subclass of SeqDataSet is forced to allocate/free its own memory.
[more]int removeUnlikelyFrames(Distribution* likely_distr, Distribution* unlikely_distr, int obs_offset = 0, int range=5)
Remove the frames considering as unlinkely and return the number of removed frames
[more]void removeUnusedData(bool* mask)
Remove the column of data unused
[more]void normalizeUsingDataSet( SeqDataSet* )
Normalize the DataSet using the normalization values of another DataSet.
[more]void normalize()
normalize the database
[more]void setFrame( int )
set the current frame of the current example
[more]void totNFrames()
compute the total number of frames in the database.
[more]void toOneFramePerExample()
transform the database such that there is one frame per example.
[more]virtual void readTargets(char* file)
read seqtargets from a file
[more]virtual void readAlignments(char* file, bool needs_all_examples = false)
read alignments from a file
[more]void setSelectedFrames( int* selected_frames, int n_selected_frames )
for the current example, consider only the selected_frames
[more]void unsetSelectedFrames()
for the current example, consider all the frames
[more]void display()
print the database, for debugging purposes only
[more]virtual void loadFILE(FILE* file)
Load the normalization parameters
[more]virtual void saveFILE(FILE* file)
Save the normalization parameters


Inherited from DataSet:

Public Fields

oint* selected_examples
oint current_example
oint n_targets
ovoid* targets
oint n_inputs
oList* inputs
oint n_examples
oint n_real_examples

Public Methods

ovoid setExample(int t)
ovirtual void setRealExample(int t)
ovoid pushSubset(int* subset_, int n_examples_)
ovoid popSubset()


Inherited from Object:

Public Methods

ovirtual void init()
ovoid addOption(const char* name, int size, void* ptr, const char* help="", bool is_allowed_after_init=false)
ovoid addIOption(const char* name, int* ptr, int init_value, const char* help="", bool is_allowed_after_init=false)
ovoid addROption(const char* name, real* ptr, real init_value, const char* help="", bool is_allowed_after_init=false)
ovoid addBOption(const char* name, bool* ptr, bool init_value, const char* help="", bool is_allowed_after_init=false)
ovoid setOption(const char* name, void* ptr)
ovoid setIOption(const char* name, int option)
ovoid setROption(const char* name, real option)
ovoid setBOption(const char* name, bool option)
ovoid load(const char* filename)
ovoid save(const char* filename)


Documentation

This class defines the standard framework of Sequence Data processing

DataSet with a vector of reals for inputs, vector of reals for observations and vector of reals for targets

Options:

"normalize inputs" bool normalize the inputs by mean/stdv [ false ] "normalize observations" bool normalize the observations by mean/stdv [ false ] "normalize targets" bool normalize the targets by mean/stdv [ false ]

p

oSeqExample* examples
the vector of examples of the dataset

ochar** file_names
names of data files

oint n_file_names
the number of data files to read

obool norm_inputs
do we normalize the inputs?

obool norm_observations
do we normalize the observations?

oreal* mean_in
if we normalize the inputs, this vector contains the mean of the inputs

oreal* mean_ob
if we normalize the inputs, this vector contains the mean of the observations

oreal* stdv_in
if we normalize the inputs, this vector contains the stdev of the inputs

oreal* stdv_ob
if we normalize the inputs, this vector contains the stdev of the observations

oint current_frame
the current frame we are working on

oint n_frames
the number of frames of the current example

oint n_observations
the number of observations of the examples

oint tot_n_frames
the total number of frames in the dataset

ochar* kind
some dataset keeps an information of the kind of the data. this is used in Htk data files for instance

oint n_seqtargets
if there are targets, the length of the seqtargets matrix. Note that its width is equal to n_targets.

oreal** seqtargets
the targets of the current example

ovirtual void freeMemory() = 0
each Subclass of SeqDataSet is forced to allocate/free its own memory. This is forced upon them for historical reasons eg IOTorch allocates/frees its own memory which is used in StaticMatSeqDataSet

oint removeUnlikelyFrames(Distribution* likely_distr, Distribution* unlikely_distr, int obs_offset = 0, int range=5)
Remove the frames considering as unlinkely and return the number of removed frames

ovoid removeUnusedData(bool* mask)
Remove the column of data unused

ovoid normalizeUsingDataSet( SeqDataSet* )
Normalize the DataSet using the normalization values of another DataSet. If the other DataSet isn't normalized, nothing happens...

ovoid normalize()
normalize the database

ovoid setFrame( int )
set the current frame of the current example

ovoid totNFrames()
compute the total number of frames in the database. keep this value in tot_n_frames

ovoid toOneFramePerExample()
transform the database such that there is one frame per example. by default, each file corresponds to one sequence.

ovirtual void readTargets(char* file)
read seqtargets from a file

ovirtual void readAlignments(char* file, bool needs_all_examples = false)
read alignments from a file

ovoid setSelectedFrames( int* selected_frames, int n_selected_frames )
for the current example, consider only the selected_frames

ovoid unsetSelectedFrames()
for the current example, consider all the frames

ovoid display()
print the database, for debugging purposes only

ovirtual void loadFILE(FILE* file)
Load the normalization parameters

ovirtual void saveFILE(FILE* file)
Save the normalization parameters


Direct child classes:
PhonemeSeqDataSet
MatSeqDataSet
HtkSeqDataSet
Author:
Bison Ravi (francois.belisle@idiap.ch) Johnny Mariethoz (Johnny.Mariethoz@idiap.ch) Samy Bengio (bengio@idiap.ch)

Alphabetic index HTML hierarchy of classes or Java



This page was generated with the help of DOC++.