neopy-neorvc / README.md
NeoPy's picture
Upload folder using huggingface_hub
8bb5911 verified
# <h1 align="center"><b> [NeoRVC ๐ŸŽต](https://github.com/TheNeodev/NeoRVC.git) </b></h1>
<div align="center">
![gelbooru counter](https://count.nett.moe/get/foo/img?theme=gelbooru)
---
[![License: BSD-3-Clause](https://img.shields.io/badge/License-BSD_3--Clause-black.svg?style=for-the-badge&color=red&logo=shadow-the-hedgehog&logoColor=white
)](https://github.com/TheNeodev/NeoRVC/LICENSE)
[![Open In Colab](https://img.shields.io/badge/Open%20In-Colab-%23D21F2D?logo=google-colab&style=for-the-badge&logoColor=%23FF6A00)](https://colab.research.google.com/drive/1Khdhc_96g_W271aeYpLIXI3CxMl6QYdQ?usp=sharing)
----
An extension of [AIcoverGen](https://github.com/SociallyIneptWeeb/AICoverGen) to create covers with any RVC v2 trained AI voice from YouTube videos or a local audio file. For developers who may want to add a singing functionality into their AI assistant/chatbot/vtuber, or for people who want to hear their favourite characters sing their favourite song. to create covers with any RVC v2 trained AI voice from YouTube videos or a local audio file. For developers who may want to add a singing functionality into their AI assistant/chatbot/vtuber, or for people who want to hear their favourite characters sing their favourite song.
</div>
## Changelog
- WebUI for easier conversions and downloading of voice models
- Hybrid Pitch detection method control Method
- Support for cover generations from a local audio file
- Option to keep intermediate files generated. e.g. Isolated vocals/instrumentals
- Download suggested public voice models from table with search/tag filters
- Support for Pixeldrain download links for voice models
- Implement new rmvpe pitch extraction technique for faster and higher quality vocal conversions
- Volume control for AI main vocals, backup vocals and instrumentals
- Index Rate for Voice conversion
- Reverb Control for AI main vocals
- Local network sharing option for webui
- Extra RVC options - filter_radius, rms_mix_rate, protect
- Local file upload via file browser option
- Upload of locally trained RVC v2 models via WebUI
- Pitch detection method control, e.g. rmvpe/crepe/fcpe
- Pitch change for vocals
- Audio output format option: wav or mp3.
- Cli Inference
### How to use cli
full inference:
```
python ./neorvc/main_cli.py "https://youtube.com/watch?v=example" "my_voice_model" --pitch_change 2 --keep_files --output_type full
```
vocal_only inference:
```
python ./neorvc/main_cli.py "path/to/vocals.wav" "my_voice_model" --output_type vocals
```
### References
The NeoRVC builds upon the foundations of the following projects:
- **Vocoders:**
- [HiFi-GAN](https://github.com/jik876/hifi-gan) by jik876
- [Vocos](https://github.com/gemelo-ai/vocos) by gemelo-ai
- [BigVGAN](https://github.com/NVIDIA/BigVGAN) by NVIDIA
- [BigVSAN](https://github.com/sony/bigvsan) by sony
- [vocoders](https://github.com/reppy4620/vocoders) by reppy4620
- [vocoder](https://github.com/fishaudio/vocoder) by fishaudio
- **VC Clients:**
- [Retrieval-based-Voice-Conversion-WebUI](https://github.com/RVC-Project/Retrieval-based-Voice-Conversion-WebUI) by RVC-Project
- [rvc-cli](https://github.com/blaisewf/rvc-cli.git) by blaisewf
- [So-Vits-SVC](https://github.com/svc-develop-team/so-vits-svc) by svc-develop-team
- [Mangio-RVC-Fork](https://github.com/Mangio621/Mangio-RVC-Fork) by Mangio621
- [VITS](https://github.com/jaywalnut310/vits) by jaywalnut310
- [Harmonify](https://huggingface.co/Eempostor/Harmonify) by Eempostor
- [rvc-trainer](https://github.com/thepowerfuldeez/rvc-trainer) by thepowerfuldeez
- [AICoverGen](https://github.com/SociallyIneptWeeb/AICoverGen) by SociallyIneptWeeb
- **Pitch Extractors:**
- [RMVPE](https://github.com/Dream-High/RMVPE) by Dream-High
- [torchfcpe](https://github.com/CNChTu/FCPE) by CNChTu
- [torchcrepe](https://github.com/maxrmorrison/torchcrepe) by maxrmorrison
- [anyf0](https://github.com/SoulMelody/anyf0) by SoulMelody
- **Other:**
- [FAIRSEQ](https://github.com/facebookresearch/fairseq) by facebookresearch
- [FAISS](https://github.com/facebookresearch/faiss) by facebookresearch
- [ContentVec](https://github.com/auspicious3000/contentvec/) by auspicious3000
- [audio-slicer](https://github.com/openvpi/audio-slicer) by openvpi
- [python-audio-separator](https://github.com/nomadkaraoke/python-audio-separator.git) by nomadkaraoke
**We acknowledge and appreciate the contributions of the respective authors and communities involved in these projects.**
## Contributions
If you want to participate and help me with this project feel free to create an [issue](https://github.com/TheNeodev/NeoRVC/issues) if something goes wrong or make a [pull request](https://github.com/TheNeodev/NeoRVC/pulls) to improve this project.
Any type of contribution is welcome ๐Ÿ”ฅ
**If you like this project you can star this repository. I will appreciate a lot ๐Ÿ˜ธ**
You can donate to the me on here:
[!["Support Me On Saweria"](https://img.shields.io/badge/Support%20me%20on-Saweria-%23FF0000?logo=sonic&logoColor=black&labelColor=black)](https://saweria.co/neodev)
## Thanks to all contributors for their efforts
<a href="https://github.com/TheNeodev/NeoRVC/graphs/contributors">
<img src="https://contrib.rocks/image?repo=TheNeodev/NeoRVC" />
</a>