GitHub

Return of the Encoder: Efficient Small Language Models

We note that our work focuses on architectural comparisons rather than competing with recent SLM developments (e.g., SmolLM, MobileLLM). Our analysis isolates the fundamental advantages of ...
IEEE

Mitigating Backdoor Attacks in Pre-Trained Encoders via Self-Supervised Knowledge Distillation

Abstract: Pre-trained encoders in computer vision have recently received great attention from both research and industry communities. Among others, a promising paradigm is to utilize self-supervised ...
GitHub

ComfyUI Qwen 3.5 4B Text Encoder for Anima 2B

A custom ComfyUI node that adds support for the Qwen 3.5 4B hybrid (Mamba2 + Attention) text encoder for use with the Anima 2B diffusion model. The base Anima 2B ships with a Qwen 3 0.6B text encoder.
IEEE

A Semi-Supervised Semantic and Spatial Change Detail Retention Network for Semantic Change Detection in Remote Sensing Images

Abstract: The task of semantic change detection (SCD) in remote sensing images (RSIs) is aimed at identifying the multiple “from-to” changes in land cover. However, the prevailing multitask SCD ...