File LRPpreprocessorPOStagger Documentation

Automatically generated with Code Structure Viewer (CS), Project Version: 3o4d 17-November-2020

Copyright © 2020, BAI Research. All Rights Reserved.

File Name: LRPpreprocessorPOStagger.cpp/.hpp

File Description: LRP preprocessor POS tagger

File Function List


File Diagram (functions hierarchy)


Function LRPpreprocessorPOStaggerClass::generatePOStaggerDatabaseFromWikiDumpText()

Function Summary
namereturn typedescription
generatePOStaggerDatabaseFromWikiDumpTextboolgenerate POS tagger database from wiki dump text

Function Arguments
nametypedescription
wikiDumpFolderNamestring wiki dump folder name
useLRP const bool use LRP

Function Reference List


Function Trace
locationcurrent function being traced
LRPmain.hppgeneratePOStaggerDatabaseFromWikiDumpText

Trace Diagram (magenta)


Function LRPpreprocessorPOStaggerClass::generatePOStaggerDatabaseFromWikiDumpText()

Function Summary
namereturn typedescription
generatePOStaggerDatabaseFromWikiDumpTextboolgenerate POS tagger database from wiki dump text

Function Arguments
nametypedescription
wikiDumpFolderNamestring wiki dump folder name
wikiDumpFileBatchIndex int wiki dump file batch index
useLRP const bool use LRP

Function Reference List


Function Trace
locationcurrent function being traced
LRPmain.hppgeneratePOStaggerDatabaseFromWikiDumpText
LRPpreprocessorPOStagger.hppgeneratePOStaggerDatabaseFromWikiDumpText

Trace Diagram (magenta)


Function LRPpreprocessorPOStaggerClass::addPOStaggerDatabaseEntry1()

Function Summary
namereturn typedescription
addPOStaggerDatabaseEntry1booladd POS tagger database entry 1

Function Arguments
nametypedescription
POSambiguityInfoPermutationconst vector<uint64_t>* POS ambiguity info permutation
XtrainBatchFileObject ofstream* Xtrain batch file object

Function Reference List


Function Trace
locationcurrent function being traced
LRPpreprocessorPOStagger.hppaddPOStaggerDatabaseEntry1
LRPmain.hppgeneratePOStaggerDatabaseFromWikiDumpText
LRPpreprocessorPOStagger.hppgeneratePOStaggerDatabaseFromWikiDumpText

Trace Diagram (magenta)


Function LRPpreprocessorPOStaggerClass::addPOStaggerDatabaseEntry2()

Function Summary
namereturn typedescription
addPOStaggerDatabaseEntry2booladd POS tagger database entry 2

Function Arguments
nametypedescription
centreWordPOSambiguityInfouint64_t centre word POS ambiguity info
POSambiguityInfoPermutation vector<uint64_t>* POS ambiguity info permutation
centreWordUnambiguousPOSindex uchar centre word unambiguous POS index
XtrainBatchFileObject ofstream* Xtrain batch file object
YtrainBatchFileObject ofstream* Ytrain batch file object

Function Reference List
N/A


Function Trace
locationcurrent function being traced
LRPpreprocessorPOStagger.hppaddPOStaggerDatabaseEntry2
LRPmain.hppgeneratePOStaggerDatabaseFromWikiDumpText
LRPpreprocessorPOStagger.hppgeneratePOStaggerDatabaseFromWikiDumpText

Trace Diagram (magenta)


Function LRPpreprocessorPOStaggerClass::addPOStaggerDatabaseEntry3()

Function Summary
namereturn typedescription
addPOStaggerDatabaseEntry3booladd POS tagger database entry 3

Function Arguments
nametypedescription
centreWordPOSambiguityInfouint64_t centre word POS ambiguity info
POSambiguityInfoPermutation vector<uint64_t>* POS ambiguity info permutation
centreWordUnambiguousPOSindex uchar centre word unambiguous POS index
currentExperienceInList ANNexperience** current experience in list

Function Reference List
N/A


Function Trace
locationcurrent function being traced
LRPpreprocessorPOStagger.hppaddPOStaggerDatabaseEntry3
LRPmain.hppgeneratePOStaggerDatabaseFromWikiDumpText
LRPpreprocessorPOStagger.hppgeneratePOStaggerDatabaseFromWikiDumpText

Trace Diagram (magenta)


Function LRPpreprocessorPOStaggerClass::addPOStaggerDatabaseEntry4()

Function Summary
namereturn typedescription
addPOStaggerDatabaseEntry4booladd POS tagger database entry 4

Function Arguments
nametypedescription
centreWordPOSambiguityInfouint64_t centre word POS ambiguity info
POSambiguityInfoPermutation vector<uint64_t>* POS ambiguity info permutation
centreWordUnambiguousPOSindex uchar centre word unambiguous POS index
numberOfNeuralNetworkFeeds int64_t* number of neural network feeds

Function Reference List
N/A


Function Trace
locationcurrent function being traced
LRPpreprocessorPOStagger.hppaddPOStaggerDatabaseEntry4
LRPmain.hppgeneratePOStaggerDatabaseFromWikiDumpText
LRPpreprocessorPOStagger.hppgeneratePOStaggerDatabaseFromWikiDumpText

Trace Diagram (magenta)


Function LRPpreprocessorPOStaggerClass::generateWikiDumpTextInputFileName()

Function Summary
namereturn typedescription
generateWikiDumpTextInputFileNamestringgenerate wiki dump text input file name

Function Arguments
nametypedescription
wikiDumpFileBatchIndexconst int wiki dump file batch index

Function Reference List


Function Trace
locationcurrent function being traced
LRPpreprocessorPOStagger.hppgenerateWikiDumpTextInputFileName
LRPmain.hppgeneratePOStaggerDatabaseFromWikiDumpText
LRPpreprocessorPOStagger.hppgeneratePOStaggerDatabaseFromWikiDumpText

Trace Diagram (magenta)


Function LRPpreprocessorPOStaggerClass::generatePreprocessorSentenceObjectsFromText()

Function Summary
namereturn typedescription
generatePreprocessorSentenceObjectsFromTextboolgenerate preprocessor sentence objects from text

Function Arguments
nametypedescription
inputFileNameconst string input file name
firstLRPpreprocessorSentenceInText LRPpreprocessorSentence* first LRP preprocessor sentence in text
useLRP const bool use LRP

Function Reference List


Function Trace
locationcurrent function being traced
LRPpreprocessorPOStagger.hppgeneratePreprocessorSentenceObjectsFromText
LRPmain.hppgeneratePOStaggerDatabaseFromWikiDumpText
LRPpreprocessorPOStagger.hppgeneratePOStaggerDatabaseFromWikiDumpText

Trace Diagram (magenta)


Function LRPpreprocessorPOStaggerClass::createPreprocessSentencesBasic()

Function Summary
namereturn typedescription
createPreprocessSentencesBasicboolcreate preprocess sentences basic

Function Arguments
nametypedescription
fileContentsstring file contents
firstLRPpreprocessorSentenceInList LRPpreprocessorSentence* first LRP preprocessor sentence in list
interpretNewLinesAsNewSentences const bool interpret new lines as new sentences

Function Reference List


Function Trace
locationcurrent function being traced
LRPpreprocessorPOStagger.hppcreatePreprocessSentencesBasic
LRPpreprocessorPOStagger.hppgeneratePreprocessorSentenceObjectsFromText
LRPmain.hppgeneratePOStaggerDatabaseFromWikiDumpText
LRPpreprocessorPOStagger.hppgeneratePOStaggerDatabaseFromWikiDumpText

Trace Diagram (magenta)


Function LRPpreprocessorPOStaggerClass::generateANNexperienceFromPOSambiguityInfoPermutation()

Function Summary
namereturn typedescription
generateANNexperienceFromPOSambiguityInfoPermutationboolgenerate ANN experience from POS ambiguity info permutation

Function Arguments
nametypedescription
POSambiguityInfoPermutationconst vector<uint64_t>* POS ambiguity info permutation
centreWordUnambiguousPOSindex uchar centre word unambiguous POS index
currentExperience ANNexperience* current experience

Function Reference List


Function Trace
locationcurrent function being traced
LRPpreprocessorPOStagger.hppgenerateANNexperienceFromPOSambiguityInfoPermutation
LRPpreprocessorPOStagger.hppaddPOStaggerDatabaseEntry1
LRPmain.hppgeneratePOStaggerDatabaseFromWikiDumpText
LRPpreprocessorPOStagger.hppgeneratePOStaggerDatabaseFromWikiDumpText

Trace Diagram (magenta)


Function LRPpreprocessorPOStaggerClass::generatePOSambiguityInfoPermutation()

Function Summary
namereturn typedescription
generatePOSambiguityInfoPermutationboolgenerate POS ambiguity info permutation

Function Arguments
nametypedescription
sentenceContentsvector<LRPpreprocessorPlainTextWord*>* sentence contents
wCentre const int wCentre
identifiedEveryWordInDatabasePOSpermutation bool* identified every word in database POS permutation
identifiedEveryWordInDatabasePOSpermutationIsUnambiguous bool* identified every word in database POS permutation is unambiguous
POSambiguityInfoPermutation vector<uint64_t>* POS ambiguity info permutation

Function Reference List


Function Trace
locationcurrent function being traced
LRPpreprocessorPOStagger.hppgeneratePOSambiguityInfoPermutation
LRPmain.hppgeneratePOStaggerDatabaseFromWikiDumpText
LRPpreprocessorPOStagger.hppgeneratePOStaggerDatabaseFromWikiDumpText

Trace Diagram (magenta)


Function LRPpreprocessorPOStaggerClass::generatePOSambiguityInfoUnambiguousPermutationArray()

Function Summary
namereturn typedescription
generatePOSambiguityInfoUnambiguousPermutationArrayvoidgenerate POS ambiguity info unambiguous permutation array

Function Arguments
nametypedescription
POSambiguityInfoUnambiguousPermutationArrayvector<vector<uint64_t>*>* POS ambiguity info unambiguous permutation array
POSambiguityInfoPermutation vector<uint64_t>* POS ambiguity info permutation
POSambiguityInfoUnambiguousPermutationLocal vector<uint64_t>* POS ambiguity info unambiguous permutation local
wordIndex int word index

Function Reference List


Function Trace
locationcurrent function being traced
LRPpreprocessorPOStagger.hppgeneratePOSambiguityInfoUnambiguousPermutationArray
LRPmain.hppgeneratePOStaggerDatabaseFromWikiDumpText
LRPpreprocessorPOStagger.hppgeneratePOStaggerDatabaseFromWikiDumpText

Trace Diagram (magenta)


Function LRPpreprocessorPOStaggerClass::determinePOSambiguityInfo()

Function Summary
namereturn typedescription
determinePOSambiguityInfobooldetermine POS ambiguity info

Function Arguments
nametypedescription
contextWordconstEffective LRPpreprocessorPlainTextWord* context word
contextWordPOSambiguityInfo uint64_t* context word POS ambiguity info
contextWordPOSisAmbiguous bool* context word POS is ambiguous
contextWordUnambiguousPOSindex uchar* context word unambiguous POS index
identifiedEveryWordInDatabasePOSpermutation bool* identified every word in database POS permutation

Function Reference List


Function Trace
locationcurrent function being traced
LRPpreprocessorPOStagger.hppdeterminePOSambiguityInfo
LRPpreprocessorPOStagger.hppgeneratePOSambiguityInfoPermutation
LRPmain.hppgeneratePOStaggerDatabaseFromWikiDumpText
LRPpreprocessorPOStagger.hppgeneratePOStaggerDatabaseFromWikiDumpText

Trace Diagram (magenta)


Function LRPpreprocessorPOStaggerClass::findWordInWordListAllTypesWithPOSambiguityInfo()

Function Summary
namereturn typedescription
findWordInWordListAllTypesWithPOSambiguityInfoboolfind word in word list all types with POS ambiguity info

Function Arguments
nametypedescription
wordconst string word
wordFound LRPpreprocessorMultiwordReductionWord** word found
POSambiguityInfoFound uint64_t* POS ambiguity info found

Function Reference List


Function Trace
locationcurrent function being traced
LRPpreprocessorPOStagger.hppfindWordInWordListAllTypesWithPOSambiguityInfo
LRPpreprocessorPOStagger.hppdeterminePOSambiguityInfo
LRPpreprocessorPOStagger.hppgeneratePOSambiguityInfoPermutation
LRPmain.hppgeneratePOStaggerDatabaseFromWikiDumpText
LRPpreprocessorPOStagger.hppgeneratePOStaggerDatabaseFromWikiDumpText

Trace Diagram (magenta)


Function LRPpreprocessorPOStaggerClass::generateANNexperienceFromPOSambiguityInfoPermutationStandalone()

Function Summary
namereturn typedescription
generateANNexperienceFromPOSambiguityInfoPermutationStandaloneboolgenerate ANN experience from POS ambiguity info permutation standalone

Function Arguments
nametypedescription
POSambiguityInfoPermutationconst vector<uint64_t>* POS ambiguity info permutation
outputNeuronExperienceValue uchar output neuron experience value
currentExperience ANNexperience* current experience

Function Reference List


Function Trace
locationcurrent function being traced
LRPpreprocessorPOStagger.hppgenerateANNexperienceFromPOSambiguityInfoPermutationStandalone
LRPpreprocessorPOStagger.hppgenerateANNexperienceFromPOSambiguityInfoPermutation
LRPpreprocessorPOStagger.hppaddPOStaggerDatabaseEntry1
LRPmain.hppgeneratePOStaggerDatabaseFromWikiDumpText
LRPpreprocessorPOStagger.hppgeneratePOStaggerDatabaseFromWikiDumpText

Trace Diagram (magenta)


Function LRPpreprocessorPOStaggerClass::setSentenceContentsWordsUnambiguousPOSindex()

Function Summary
namereturn typedescription
setSentenceContentsWordsUnambiguousPOSindexboolset sentence contents words unambiguous POS index

Function Arguments
nametypedescription
sentenceContentsvector<LRPpreprocessorPlainTextWord*>* sentence contents
POSambiguityInfoPermutationTemp const vector<uint64_t>* POS ambiguity info permutation temp

Function Reference List


Function Trace
locationcurrent function being traced
LRPpreprocessorPOStagger.hppsetSentenceContentsWordsUnambiguousPOSindex
LRPmain.hppgeneratePOStaggerDatabaseFromWikiDumpText
LRPpreprocessorPOStagger.hppgeneratePOStaggerDatabaseFromWikiDumpText

Trace Diagram (magenta)