GitHub

GRAPE: Group Representational Position Encoding

GRAPE is a unified group-theoretic framework for positional encoding that subsumes multiplicative mechanisms (like RoPE) and additive mechanisms (like ALiBi and FoX) under a single mathematical ...
IEEE

Dynamically Relative Position Encoding-Based Transformer for Automatic Code Edit

Abstract: Adapting deep learning (DL) techniques to automate nontrivial coding activities, such as code documentation and defect detection, has been intensively studied recently. Learning to predict ...
IEEE

Point Cloud Completion via Relative Point Position Encoding and Regional Attention

Abstract: The global feature encoding and surface detail refinement are two critical components for point-based point cloud completion methods. However, existing methods typically use max pooling to ...
GitHub

V-DETR: DETR with Vertex Relative Position Encoding for 3D Object Detection

This is the official implementation of the paper "V-DETR: DETR with Vertex Relative Position Encoding for 3D Object Detection". Step 3. install Minkowski Engine. git ...
VentureBeat

Meta quietly unveils Llama 2 Long AI that beats GPT-3.5 Turbo and Claude 2 on some tasks

Meta Platforms showed off a bevy of new AI features for its consumer-facing services Facebook, Instagram and WhatsApp at its annual Meta Connect conference in Menlo Park, California, this week. But ...
Microsoft

V-DETR: DETR with Vertex Relative Position Encoding for 3D Object Detection

We introduce a highly performant 3D object detector for point clouds using the DETR framework. The prior attempts all end up with suboptimal results because they fail to learn accurate inductive ...