Update README.md
Browse files
README.md
CHANGED
@@ -22,7 +22,19 @@ tags:
|
|
22 |
[](https://paperswithcode.com/sota/code-generation-on-apps?metric=Introductory%20Pass%401/motcoder-elevating-large-language-models-with)
|
23 |
[](https://paperswithcode.com/sota/code-generation-on-codecontests?metric=Test%20Set%20pass%401)
|
24 |
|
25 |
-
Large Language Models (LLMs) have showcased impressive capabilities in handling straightforward programming tasks.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
26 |
|
27 |
<div style="text-align: center;">
|
28 |
<img src="impression.png" alt="impression" />
|
|
|
22 |
[](https://paperswithcode.com/sota/code-generation-on-apps?metric=Introductory%20Pass%401/motcoder-elevating-large-language-models-with)
|
23 |
[](https://paperswithcode.com/sota/code-generation-on-codecontests?metric=Test%20Set%20pass%401)
|
24 |
|
25 |
+
Large Language Models (LLMs) have showcased impressive capabilities in handling straightforward programming tasks.
|
26 |
+
However, their performance tends to falter when confronted with more challenging programming problems.
|
27 |
+
We observe that conventional models often generate solutions as monolithic code blocks, restricting their effectiveness in tackling intricate questions.
|
28 |
+
To overcome this limitation, we present Module-of-Thought Coder (MoTCoder).
|
29 |
+
We introduce a framework for MoT instruction tuning, designed to promote the decomposition of tasks into logical sub-tasks and sub-modules.
|
30 |
+
Our investigations reveal that, through the cultivation and utilization of sub-modules,
|
31 |
+
MoTCoder significantly improves both the modularity and correctness of the generated solutions,
|
32 |
+
leading to substantial pass@1 improvements of 5.8% on APPS and 5.9% on CodeContests.
|
33 |
+
MoTCoder also achieved significant improvements in self-correction capabilities, surpassing the current SOTA by 3.3%.
|
34 |
+
Additionally, we provide an analysis of between problem complexity and optimal module decomposition and evaluate the maintainability index,
|
35 |
+
confirming that the code generated by MoTCoder is easier to understand and modify,
|
36 |
+
which can be beneficial for long-term code maintenance and evolution.
|
37 |
+
Our codes are available at https://github.com/dvlab-research/MoTCoder.
|
38 |
|
39 |
<div style="text-align: center;">
|
40 |
<img src="impression.png" alt="impression" />
|