As NLP stands for ‘Natural Language Processing’, it’s not surprising that the field typically dealt with ‘Natural Language’: human-like conversational and written text.

Recently though, the NLP field has been widening it’s field of view to also include processing ‘Programming Language’.

Clear indications of this interesting evolution are:

-The rise of appropriate metrics (eg. CodeGlue)
-The rise of enormous datasets (eg. CodeSearchNet)
-The rise of benchmarks (eg. CodeXGlue)
-The rise of pretrained models (eg. CodeT5, CodeBERT, PLBart, etc.)
-The rise of commercial products (eg. OpenAI Codex / Github CoPilot)
‍
So due time we investigate this emerging field and try to make our mark on it!

One mark we can make on this is to make a commit message generator application. AI is especially useful when used to automate human-like tasks that are not that hard, add value and that humans dislike / skip over. Creating meaningful commit messages definitely falls under this category!