IR2V EC : LLVM IR Based Scalable Program Embeddings

VenkataKeerthy, S. and Aggarwal, Rohit and Jain, Shalini and Desarkar, Maunendra Sankar and Upadrasta, Ramakrishna and Srikant, Y. N. (2020) IR2V EC : LLVM IR Based Scalable Program Embeddings. ACM Transactions on Architecture and Code Optimization, 17 (4). pp. 1-27. ISSN 1544-3566

Full text not available from this repository. (Request a copy)


We propose IR2VEC, a Concise and Scalable encoding infrastructure to represent programs as a distributed embedding in continuous space. This distributed embedding is obtained by combining representation learning methods with flow information to capture the syntax as well as the semantics of the input programs. As our infrastructure is based on the Intermediate Representation (IR) of the source code, obtained embeddings are both language and machine independent. The entities of the IR are modeled as relationships, and their representations are learned to form a seed embedding vocabulary. Using this infrastructure, we propose two incremental encodings: Symbolic and Flow-Aware. Symbolic encodings are obtained from the seed embedding vocabulary, and Flow-Aware encodings are obtained by augmenting the Symbolic encodings with the flow information. We show the effectiveness of our methodology on two optimization tasks (Heterogeneous device mapping and Thread coarsening). Our way of representing the programs enables us to use non-sequential models resulting in orders of magnitude of faster training time. Both the encodings generated by IR2VEC outperform the existing methods in both the tasks, even while using simple machine learning models. In particular, our results improve or match the state-of-the-art speedup in 11/14 benchmark-suites in the device mapping task across two platforms and 53/68 benchmarks in the thread coarsening task across four different platforms. When compared to the other methods, our embeddings are more scalable, is non-data-hungry, and has better Out-Of-Vocabulary (OOV) characteristics.

[error in script]
IITH Creators:
IITH CreatorsORCiD
VenkataKeerthy, S.UNSPECIFIED
Aggarwal, RohitUNSPECIFIED
Desarkar, Maunendra SankarUNSPECIFIED
Upadrasta, RamakrishnaUNSPECIFIED
Item Type: Article
Uncontrolled Keywords: Continuous spaces; Flow informations; Heterogeneous devices; Intermediate representations; Machine learning models; Optimization task; Orders of magnitude; Scalable encoding;compiler optimizations; heterogeneous systems; intermediate representations; LLVM; representation learning
Subjects: Computer science
Divisions: Department of Computer Science & Engineering
Depositing User: . LibTrainee 2021
Date Deposited: 06 Aug 2021 05:32
Last Modified: 06 Aug 2021 05:32
Publisher URL:
OA policy:
Related URLs:

Actions (login required)

View Item View Item
Statistics for RAIITH ePrint 8702 Statistics for this ePrint Item