Experience

Research experience

A Network-based Exploration to Unveil Communities of Large Language Model Modules

PI: Dr. Pin-Yu Chen, IBM; Dr. Jianxi Gao, RPI

·  Utilize network analysis to map the association between datasets and cognitive skills within LLMs, revealing the distribution of skills across different model modules.

·  Analyze the localization of skills in LLM modules and evaluate how targeted fine-tuning of modules based on specific skill distributions impacts model performance.
·  Finetuned a total of 186 models based on each community of skills: (Link)

Forecasting Open-Weight AI Model Growth on HuggingFace(Link)

PI: Dr. Pin-Yu Chen, IBM; Dr. Jianxi Gao, RPI

·  Study the trajectory of growth of a number of fine-tuned models after release.

·  Compare the impact of different companies on the AI community through their released models.

Boosting Reinforcement Learning for Network Analysis with Data Augmentation Strategies                     

PI: Dr. Pin-Yu Chen, IBM; Dr. Sholom Havlin, Bar-Ilan University; Dr. Jianxi Gao, RPI

·  Created a robust RL and GNN framework as a medium for finding critical nodes in complex networks.

·  Analyzed synthetic and real-world graphs on different critical node problems using targeted attacks.

Financial Recall Using Large Language Models

Co-Author: Xiaowei Wang, RPI | PI: Dr. Jianxi Gao, RPI

·  Create a framework to retrieve and process financial datasets using BERT-based models and index them with FAISS for efficient similarity searches.

·   Fine-tuned Llama2 with BGE embeddings and re-ranker to achieve state-of-the-art results in sentiment analysis across financial domains.

On the Robustness of Large Language Models for Tabular Question Answering(Link)

Co-Author: Sixue Xing | PI: Dr. Soham Dan, IBM; Dr. Jianxi Gao, RPI

·  Analyze structural and value-based perturbation of tabular question answering using LLM.

·  Study the impact of few-shot prompting on tabular question-answering tasks using different sizes of LLMs.

·  Evaluate changes in the performance of newer versions of LLM models.

Convolutional Neural Network-based EEG Emotion Classification with the Forward Selection Wrapper technique for Channel Selection (Link)

Advisor: Dr. Jon G. Sigurjonsson, University of Iceland

·  Used forward selection wrapper technique for channel filtration.

·  Used Keras to create a Convolutional Neural Network (CNN) that classifies emotion using the DEAP dataset.

Work Experience

• Web Development Intern, Temple Sinai, 208 Summit Avenue, Summit, NJ  [July 2019- Sept 2019]
  - Build and deploy a website using React as a tool in a suitable web hosting platform
  - Explore ideas with the client to come forward with an appealing website

• Web App and App Developer, Hazelnut  [June 2019 – Feb 2020]
  -Front-end engineering team for implementing UI design of the website and the mobile app

-Assist Hazelnut core developers with application beta-testing and application deployment

• Student Technician, IT Department, Caldwell University, Caldwell, New Jersey   [Aug 2018 – May 2021]
  - Provided timely resolutions to your technology inquiries
  - Fix technical issues in faculty, staff, or student’s computer devices

• Peer Tutor, Academic Success Center, Caldwell University, Caldwell, New Jersey  [Sept 2017- Dec 2020]
  - Tutored Mathematics and Computer Science courses to students in need

- Recorded and analyzed data of all the tutors to create a report for the Supervisor