FunBERT: Pre-training and Fine-Tuning Transformers for Genomic Insights
Deep Learning + Bioinformatics
Developed a custom foundation model for fungal genomes based on the Transformer architecture, enabling genomic sequence analysis and classification in fungal DNA.
- Pre-trained the model from scratch and fine-tuned it for downstream tasks while ensuring scalability for large-scale genomic data processing.
- Achieved over 97% accuracy in DNA sequence classification, demonstrating the model’s effectiveness in genomic analysis.
Optimizing Financial Report Analysis with LLMs and Semi-supervised Learning
NLP + Large Language Models
Leveraged LLMs as data annotators using prompt engineering and a RAG system in semi-supervised learning to improve label quality and reduce reliance on manually labeled data for analyzing quarterly earnings call reports for a private company.
- Fine-tuned BERT-based models for stance detection using LLM-generated pseudo-labels to enhance financial sentiment analysis in earnings call transcripts.
- Achieved average model accuracy over 85%.
AI-Driven Social Media Analysis for Vaccine Sentiment
Social Media + NLP
Analyzed ten years (2013-2022) of social media data using LLMs and NLP techniques, including lexicon-based analysis and topic modeling, to examine sentiment, stance, and trends related to vaccines.
- Implemented large-scale data crawling pipelines and conducted temporal, geospatial, and statistical analysis.
- Published in PLOS ONE; dataset and code released openly.
Commercial Motor Vehicle Crash Severity Prediction
Machine Learning + Transportation Safety
Developed and optimized machine learning models (Random Forest, CatBoost, XGBoost, Gradient Boosting, and Transformer-based models) for crash injury severity classification.
- Designed and implemented a scalable ML pipeline for data preprocessing, feature engineering, and model training on large-scale tabular datasets.
- Enhanced model interpretability and explainability using the SHAP framework, providing insights into feature importance and decision-making.
Time Series Anomaly Detection in Medical Break-the-Glass
Machine Learning + Healthcare Security
Implemented anomaly detection models (Gaussian Mixture Model) to identify anomalous user sessions during medical emergency access (break-the-glass) events.
- Developed a two-tiered prediction system: a real-time fast analysis engine and a post-hoc detailed statistical evaluation model.
- Applied statistical modeling techniques to calculate likelihood scores for session anomalies, improving post-event auditing and security enforcement.