Software developers typically rely on tools like IDEs to develop secure software (i.e., to detect bugs or get suggestions for a secure way to accomplish a given task).

With the recent advent of AI and the availability of a large body of software data like Github, it is natural to wonder if we can adapt these to aid with Software development.With the emergence of frameworks like the code language models of Meta/ Microsoft and Github's Copilot, it is clear that this direction is already being explored quite actively.

Such approaches have shown remarkable progress both with code completion and bug detection. All this being said, such language models treat code primarily as text ignoring a lot of semantic information encoded within the programming language and the domain ...