Text2SQL Task T5-Base + E-commerce pre-training

This is our T5 model pre-trained on 18k e-commerce pages from popular blogs and fine-tuned on Spider using a schema serialization.

Running the model

Inspired by the work done by Picard by adding a pre-training step for better performance on e-commerce data.

[question] | [db_id] | [table] : [column] ( [content] , [content] ) , [column] ( ... ) , [...] | [table] : ... | ...