SemChunk-C: Semantic Segmentation for C Code

The paper introduces SemChunk-C, a family of lightweight language models designed for semantic segmentation of C-related code, utilizing four Ettin encoders with parameter sizes of 17M, 32M, 68M, and 150M. The models effectively identify chunk boundaries and assign functional attributes, achieving high accuracy and semantic coherence on real-world code, including complex constructs like nested definitions and macros. This advancement is significant for practitioners as it enhances code retrieval and other downstream tasks by providing more meaningful functional units compared to existing methods.