Spaces:
Running
on
Zero
Running
on
Zero
File size: 3,252 Bytes
efa71f7 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 |
# Shap-E
This is the official code and model release for [Shap-E: Generating Conditional 3D Implicit Functions](https://arxiv.org/abs/2305.02463).
* See [Usage](#usage) for guidance on how to use this repository.
* See [Samples](#samples) for examples of what our text-conditional model can generate.
# Samples
Here are some highlighted samples from our text-conditional model. For random samples on selected prompts, see [samples.md](samples.md).
<table>
<tbody>
<tr>
<td align="center">
<img src="samples/a_chair_that_looks_like_an_avocado/2.gif" alt="A chair that looks like an avocado">
</td>
<td align="center">
<img src="samples/an_airplane_that_looks_like_a_banana/3.gif" alt="An airplane that looks like a banana">
</td align="center">
<td align="center">
<img src="samples/a_spaceship/0.gif" alt="A spaceship">
</td>
</tr>
<tr>
<td align="center">A chair that looks<br>like an avocado</td>
<td align="center">An airplane that looks<br>like a banana</td>
<td align="center">A spaceship</td>
</tr>
<tr>
<td align="center">
<img src="samples/a_birthday_cupcake/3.gif" alt="A birthday cupcake">
</td>
<td align="center">
<img src="samples/a_chair_that_looks_like_a_tree/2.gif" alt="A chair that looks like a tree">
</td>
<td align="center">
<img src="samples/a_green_boot/3.gif" alt="A green boot">
</td>
</tr>
<tr>
<td align="center">A birthday cupcake</td>
<td align="center">A chair that looks<br>like a tree</td>
<td align="center">A green boot</td>
</tr>
<tr>
<td align="center">
<img src="samples/a_penguin/1.gif" alt="A penguin">
</td>
<td align="center">
<img src="samples/ube_ice_cream_cone/3.gif" alt="Ube ice cream cone">
</td>
<td align="center">
<img src="samples/a_bowl_of_vegetables/2.gif" alt="A bowl of vegetables">
</td>
</tr>
<tr>
<td align="center">A penguin</td>
<td align="center">Ube ice cream cone</td>
<td align="center">A bowl of vegetables</td>
</tr>
</tbody>
<table>
# Usage
Install with `pip install -e .`.
To get started with examples, see the following notebooks:
* [sample_text_to_3d.ipynb](shap_e/examples/sample_text_to_3d.ipynb) - sample a 3D model, conditioned on a text prompt.
* [sample_image_to_3d.ipynb](shap_e/examples/sample_image_to_3d.ipynb) - sample a 3D model, conditioned on a synthetic view image. To get the best result, you should remove background from the input image.
* [encode_model.ipynb](shap_e/examples/encode_model.ipynb) - loads a 3D model or a trimesh, creates a batch of multiview renders and a point cloud, encodes them into a latent, and renders it back. For this to work, install Blender version 3.3.1 or higher, and set the environment variable `BLENDER_PATH` to the path of the Blender executable.
|