File size: 5,454 Bytes
c4f9a8d
 
 
 
 
 
 
 
57e5631
c4f9a8d
1c7d911
 
 
 
 
 
4887351
 
1c7d911
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
c4f9a8d
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
---
license: mit
title: NeoRVC
sdk: gradio
emoji: πŸƒ
colorFrom: red
colorTo: indigo
pinned: true
sdk_version: 5.29.0
---
# <h1 align="center"><b> [NeoRVC 🎡](https://github.com/TheNeodev/NeoRVC.git) </b></h1>
<div align="center">

![gelbooru counter](https://count.nett.moe/get/foo/img?theme=gelbooru)


---

[![License: BSD-3-Clause](https://img.shields.io/badge/License-BSD_3--Clause-black.svg?style=for-the-badge&color=red&logo=shadow-the-hedgehog&logoColor=white
)](https://github.com/TheNeodev/NeoRVC/LICENSE)
[![Open In Colab](https://img.shields.io/badge/Open%20In-Colab-%23D21F2D?logo=google-colab&style=for-the-badge&logoColor=%23FF6A00)](https://colab.research.google.com/drive/1Khdhc_96g_W271aeYpLIXI3CxMl6QYdQ?usp=sharing)




----

An extension of [AIcoverGen](https://github.com/SociallyIneptWeeb/AICoverGen) to create covers with any RVC v2 trained AI voice from YouTube videos or a local audio file. For developers who may want to add a singing functionality into their AI assistant/chatbot/vtuber, or for people who want to hear their favourite characters sing their favourite song. to create covers with any RVC v2 trained AI voice from YouTube videos or a local audio file. For developers who may want to add a singing functionality into their AI assistant/chatbot/vtuber, or for people who want to hear their favourite characters sing their favourite song.


</div>


## Changelog

- WebUI for easier conversions and downloading of voice models
- Hybrid Pitch detection method control Method
- Support for cover generations from a local audio file
- Option to keep intermediate files generated. e.g. Isolated vocals/instrumentals
- Download suggested public voice models from table with search/tag filters
- Support for Pixeldrain download links for voice models
- Implement new rmvpe pitch extraction technique for faster and higher quality vocal conversions
- Volume control for AI main vocals, backup vocals and instrumentals
- Index Rate for Voice conversion
- Reverb Control for AI main vocals
- Local network sharing option for webui
- Extra RVC options - filter_radius, rms_mix_rate, protect
- Local file upload via file browser option
- Upload of locally trained RVC v2 models via WebUI
- Pitch detection method control, e.g. rmvpe/crepe/fcpe
- Pitch change for vocals 
- Audio output format option: wav or mp3.
- Cli Inference 

### How to use cli

full inference:
```
python ./neorvc/main_cli.py "https://youtube.com/watch?v=example" "my_voice_model" --pitch_change 2 --keep_files --output_type full
```

vocal_only inference:
```
python ./neorvc/main_cli.py "path/to/vocals.wav" "my_voice_model" --output_type vocals
```



### References

The NeoRVC builds upon the foundations of the following projects:

- **Vocoders:**

  - [HiFi-GAN](https://github.com/jik876/hifi-gan) by jik876
  - [Vocos](https://github.com/gemelo-ai/vocos) by gemelo-ai
  - [BigVGAN](https://github.com/NVIDIA/BigVGAN) by NVIDIA
  - [BigVSAN](https://github.com/sony/bigvsan) by sony
  - [vocoders](https://github.com/reppy4620/vocoders) by reppy4620
  - [vocoder](https://github.com/fishaudio/vocoder) by fishaudio

- **VC Clients:**

  - [Retrieval-based-Voice-Conversion-WebUI](https://github.com/RVC-Project/Retrieval-based-Voice-Conversion-WebUI) by RVC-Project
  - [rvc-cli](https://github.com/blaisewf/rvc-cli.git) by blaisewf
  - [So-Vits-SVC](https://github.com/svc-develop-team/so-vits-svc) by svc-develop-team
  - [Mangio-RVC-Fork](https://github.com/Mangio621/Mangio-RVC-Fork) by Mangio621
  - [VITS](https://github.com/jaywalnut310/vits) by jaywalnut310
  - [Harmonify](https://huggingface.co/Eempostor/Harmonify) by Eempostor
  - [rvc-trainer](https://github.com/thepowerfuldeez/rvc-trainer) by thepowerfuldeez
  - [AICoverGen](https://github.com/SociallyIneptWeeb/AICoverGen) by SociallyIneptWeeb

- **Pitch Extractors:**

  - [RMVPE](https://github.com/Dream-High/RMVPE) by Dream-High
  - [torchfcpe](https://github.com/CNChTu/FCPE) by CNChTu
  - [torchcrepe](https://github.com/maxrmorrison/torchcrepe) by maxrmorrison
  - [anyf0](https://github.com/SoulMelody/anyf0) by SoulMelody

- **Other:**
  - [FAIRSEQ](https://github.com/facebookresearch/fairseq) by facebookresearch
  - [FAISS](https://github.com/facebookresearch/faiss) by facebookresearch
  - [ContentVec](https://github.com/auspicious3000/contentvec/) by auspicious3000
  - [audio-slicer](https://github.com/openvpi/audio-slicer) by openvpi
  - [python-audio-separator](https://github.com/nomadkaraoke/python-audio-separator.git) by nomadkaraoke
  

**We acknowledge and appreciate the contributions of the respective authors and communities involved in these projects.**


## Contributions
If you want to participate and help me with this project feel free to create an [issue](https://github.com/TheNeodev/NeoRVC/issues) if something goes wrong or make a [pull request](https://github.com/TheNeodev/NeoRVC/pulls) to improve this project.

Any type of contribution is welcome πŸ”₯

**If you like this project you can star this repository. I will appreciate a lot 😸**

You can donate to the me on here:

[!["Support Me On Saweria"](https://img.shields.io/badge/Support%20me%20on-Saweria-%23FF0000?logo=sonic&logoColor=black&labelColor=black)](https://saweria.co/neodev)




## Thanks to all contributors for their efforts

 <a href="https://github.com/TheNeodev/NeoRVC/graphs/contributors">
  <img src="https://contrib.rocks/image?repo=TheNeodev/NeoRVC" />
</a>