AI & ML interests
PI: Markus J. Buehler, MIT. Our research focus on developing a new paradigm that designs materials from the molecular scale, using MD, ML and other methods.
Recent Activity
	View all activity
	
We present an approach to modifying Transformer architectures by integrating graph-aware relational reasoning into the attention mechanism.
			
	
	- 
	
	
	  lamm-mit/Llama-3.2-3B-Instruct-Sparse-GIN-orca-math-word-problemsUpdated • 10 • 1
- 
	
	
	  lamm-mit/Llama-3.2-3B-Instruct-Sparse-GIN-logic2B • Updated • 1 • 1
- 
	
	
	  lamm-mit/Llama-3.2-3B-Instruct-Sparse-GIN-bioUpdated • 1
- 
	
	
	Graph-Aware Isomorphic Attention for Adaptive Dynamics in TransformersPaper • 2501.02393 • Published • 7
We present an approach to modifying Transformer architectures by integrating graph-aware relational reasoning into the attention mechanism.
			
	
	- 
	
	
	  lamm-mit/Llama-3.2-3B-Instruct-Sparse-GIN-orca-math-word-problemsUpdated • 10 • 1
- 
	
	
	  lamm-mit/Llama-3.2-3B-Instruct-Sparse-GIN-logic2B • Updated • 1 • 1
- 
	
	
	  lamm-mit/Llama-3.2-3B-Instruct-Sparse-GIN-bioUpdated • 1
- 
	
	
	Graph-Aware Isomorphic Attention for Adaptive Dynamics in TransformersPaper • 2501.02393 • Published • 7
			models
			98
		
			
	
	
	
	
	 
				lamm-mit/ProteinGPT_medium
			Text Generation
			• 
		
				0.3B
			• 
	
				Updated
					
				
				• 
					
					4
				
	
				
				
 
				lamm-mit/cephalo
		
	
				Updated
					
				
				
				
	
				• 
					
					5
				
 
				lamm-mit/Cephalo-Gemma-3-4b-it-04-15-2025
			Image-Text-to-Text
			• 
		
				5B
			• 
	
				Updated
					
				
				
				
	
				• 
					
					1
				
 
				lamm-mit/Cephalo-Gemma-3-4b-it-04-16-2025
			Image-Text-to-Text
			• 
		
				5B
			• 
	
				Updated
					
				
				
				
	
				• 
					
					1
				
 
				lamm-mit/Cephalo-Idefics-2-vision-8b-beta
			Image-Text-to-Text
			• 
		
				8B
			• 
	
				Updated
					
				
				• 
					
					3
				
	
				• 
					
					3
				
 
				lamm-mit/AutomataGPT
		
	
				Updated
					
				
				
				
	
				• 
					
					4
				
 
				lamm-mit/VibeGen
		
	
				Updated
					
				
				
				
	
				• 
					
					1
				
 
				lamm-mit/Cephalo-Llama-3.2-11B-Vision-Instruct-128k-01-29-2025
			Image-to-Text
			• 
		
				11B
			• 
	
				Updated
					
				
				
				
	
				• 
					
					1
				
 
				lamm-mit/Cephalo-Llama-3.2-11B-Vision-Instruct-128k-01-28-2025
			Image-to-Text
			• 
		
				11B
			• 
	
				Updated
					
				
				
				
	
				• 
					
					1
				
 
				lamm-mit/Graph-Preflexor_01062025
			Text Generation
			• 
		
				4B
			• 
	
				Updated
					
				
				• 
					
					306
				
	
				• 
					
					10
				
			datasets
			47
		
			
	
	
	
	
	lamm-mit/tersoff-3atom-toy
			Viewer
			• 
	
				Updated
					
				• 
			
			5k
	
				• 
					
					13
				
				
				
lamm-mit/tersoff-3atom
	
				Updated
					
				
	
				• 
					
					2
				
				
				
lamm-mit/bioinspired-sample
			Viewer
			• 
	
				Updated
					
				• 
			
			100
	
				• 
					
					11
				
				
				
lamm-mit/leaf-microstructure
			Viewer
			• 
	
				Updated
					
				• 
			
			5k
	
				• 
					
					127
				
				
				
lamm-mit/Cahn-Hilliard-spinodal
			Viewer
			• 
	
				Updated
					
				• 
			
			1.5k
	
				• 
					
					117
				
				
				
lamm-mit/data_sample
			Viewer
			• 
	
				Updated
					
				• 
			
			400
	
				• 
					
					10
				
				
				
lamm-mit/converted_dataset_example
			Viewer
			• 
	
				Updated
					
				• 
			
			2
	
				• 
					
					4
				
				
				
lamm-mit/SAGI-1-SYMBOLIC_DATA_PLUS_REASONING_DATA_V1_100K
			Viewer
			• 
	
				Updated
					
				• 
			
			113k
	
				• 
					
					8
				
				• 
					
					2
				
lamm-mit/mlabonne-orca-math-word-problems-80k
			Viewer
			• 
	
				Updated
					
				• 
			
			80k
	
				• 
					
					11
				
				• 
					
					1
				
lamm-mit/music21_logic_dataset
			Viewer
			• 
	
				Updated
					
				• 
			
			7.5k
	
				• 
					
					5