Finalizing eval#13

Merged

zausin33 merged 115 commits intomainfrom

finalizing_eval

Oct 7, 2024

Commits on Sep 3, 2024

added normalization

Larspennig
authored and
Jonas Zausinger
committed
added beam_search for xval

Larspennig
authored and
Jonas Zausinger
committed
just changed comments

Larspennig
authored and
Jonas Zausinger
committed
corrected indexing for beam search xval

Larspennig
authored and
Jonas Zausinger
committed
removed neg token

Larspennig
authored and
Jonas Zausinger
committed
- added correct decoding for rt
Jonas Zausinger
committed
deleted negative sign from regex, so that all extracted numbers are now positive, and negative sign is encoded as normal token
Jonas Zausinger
committed
removed unused [MASK] token
Jonas Zausinger
committed
minor bug fixes in evaluation
Jonas Zausinger
committed
bug fix in evaluation
Jonas Zausinger
committed
removed early stopping checkpoint
Jonas Zausinger
committed

Commits on Sep 4, 2024

fixed number token loss:
Jonas Zausinger
committed
added logging of samples and number token loss separately
Jonas Zausinger
committed
small adjustments for training
Jonas Zausinger
committed
fixed tokenization problem when two numbers were only seperated by whitespace, that this whitespace simply disappeard
Jonas Zausinger
committed
refactored decoding logic in eval
Jonas Zausinger
committed
added preprocessing for numbers
Jonas Zausinger
committed
added preprocessing for numbers
Jonas Zausinger
committed
added tests for tokenizers
Jonas Zausinger
committed
try to run tests on each branch
Jonas Zausinger
committed

Commits on Sep 5, 2024

Commits on Sep 6, 2024

small bug fixes and reformatting
Jonas Zausinger
committed
undo debug changes
Jonas Zausinger
committed
improved evaluation by adding mae and possibility to only eval models
Jonas Zausinger
committed
Merge pull request #14 from tum-ai/final_eval_temp_vinc
zausin33
authored
improved mse and mae evaluation for this dataset
Jonas Zausinger
committed
improved mse, mae regex and improved data preprocessing
Jonas Zausinger
committed

Commits on Sep 7, 2024

write all test output to file, xval generation fix, rt model loading fix
Jonas Zausinger
committed
feat: add data augmentation script
jannisborn
committed

Commits on Sep 8, 2024

Commits on Sep 9, 2024

added possible to load pretrained t5 weights
Jonas Zausinger
committed
added correct weight init for xval
Jonas Zausinger
committed

Commits on Sep 10, 2024

Commits on Sep 11, 2024

added median_absolute_error, log_mae, log_r2,
Jonas Zausinger
committed
generation script
jannisborn
committed
Merge branch 'data_augmentation' of github.com:tum-ai/ibm_impact_project into data_augmentation
Jonas Zausinger
committed
added normalization

Larspennig
authored and
Jonas Zausinger
committed
added beam_search for xval

Larspennig
authored and
Jonas Zausinger
committed
just changed comments

Larspennig
authored and
Jonas Zausinger
committed
corrected indexing for beam search xval

Larspennig
authored and
Jonas Zausinger
committed
removed neg token

Larspennig
authored and
Jonas Zausinger
committed
- added correct decoding for rt
Jonas Zausinger
committed
deleted negative sign from regex, so that all extracted numbers are now positive, and negative sign is encoded as normal token
Jonas Zausinger
committed
removed unused [MASK] token
Jonas Zausinger
committed
minor bug fixes in evaluation
Jonas Zausinger
committed
bug fix in evaluation
Jonas Zausinger
committed
removed early stopping checkpoint
Jonas Zausinger
committed
fixed number token loss:
Jonas Zausinger
committed
added logging of samples and number token loss separately
Jonas Zausinger
committed
small adjustments for training
Jonas Zausinger
committed
fixed tokenization problem when two numbers were only seperated by whitespace, that this whitespace simply disappeard
Jonas Zausinger
committed
refactored decoding logic in eval
Jonas Zausinger
committed
added preprocessing for numbers
Jonas Zausinger
committed
added preprocessing for numbers
Jonas Zausinger
committed
added tests for tokenizers
Jonas Zausinger
committed
try to run tests on each branch
Jonas Zausinger
committed
removed data folder from git ignore
Jonas Zausinger
committed
added preprocessed data files
Jonas Zausinger
committed
Readded the metrices

VincentLimbach
authored and
Jonas Zausinger
committed
Clean up rt

VincentLimbach
authored and
Jonas Zausinger
committed
Clean up xvaltokenizer

VincentLimbach
authored and
Jonas Zausinger
committed
Modified tests to allow unpacking of counts

VincentLimbach
authored and
Jonas Zausinger
committed
small bug fixes and reformatting
Jonas Zausinger
committed
undo debug changes
Jonas Zausinger
committed
improved evaluation by adding mae and possibility to only eval models
Jonas Zausinger
committed
improved mse and mae evaluation for this dataset
Jonas Zausinger
committed
improved mse, mae regex and improved data preprocessing
Jonas Zausinger
committed
write all test output to file, xval generation fix, rt model loading fix
Jonas Zausinger
committed
added number_accuracy and r2 for evaluation
Jonas Zausinger
committed
fixed config size bug for normal t5
Jonas Zausinger
committed
added possible to load pretrained t5 weights
Jonas Zausinger
committed
added correct weight init for xval
Jonas Zausinger
committed
added median_absolute_error, log_mae, log_r2,
Jonas Zausinger
committed
added option to train with augmented data
Jonas Zausinger
committed
added option to train with augmented data
Jonas Zausinger
committed
bug-fixing xval beam search
Jonas Zausinger
committed
bug-fixing xval beam search
Jonas Zausinger
committed
added augmented data
Jonas Zausinger
committed
added easier math dataset
Jonas Zausinger
committed
removed scaling from xval
Jonas Zausinger
committed

Commits on Sep 13, 2024

fixed xval bug in generation
Jonas Zausinger
committed
removed padded tokens from loss calculation,
Jonas Zausinger
committed
fixed perplexity for label=-100, added more data for math dataset
Jonas Zausinger
committed

Commits on Sep 15, 2024

Commits on Sep 20, 2024

added feedback
Jonas Zausinger
committed
Merge branch 'kacper' into finalizing_eval
Jonas Zausinger
committed
removed resolved TODOs
Jonas Zausinger
committed
switched order of logging
Jonas Zausinger
committed
fixed init of positional embeddings
Jonas Zausinger
committed

Commits on Sep 21, 2024

added wasserstein number token loss
Jonas Zausinger
committed
completed wasserstein ntl
Jonas Zausinger
committed

Commits on Sep 22, 2024

added old rt vocab
Jonas Zausinger
committed
fixed floating point problem at rt
Jonas Zausinger
committed
fixed precision error for large numbers
Jonas Zausinger
committed

Commits on Sep 24, 2024

fixed scaling of number token loss
Jonas Zausinger
committed

Commits on Sep 27, 2024

added native xval from xval paper
Jonas Zausinger
committed
refactored config into config folder and files
Jonas Zausinger
committed

Commits on Oct 6, 2024

added vanilla_t5_regression_head
Jonas Zausinger
committed
added config for t5 large
Jonas Zausinger
committed
added config for t5 large
Jonas Zausinger
committed

Commits on Oct 7, 2024

updated README
Jonas Zausinger
committed