@@ -23,13 +23,12 @@ limitations under the License.
23
23
[ ![ GitHub Release] ( https://img.shields.io/github/v/release/ai-dynamo/dynamo )] ( https://github.com/ai-dynamo/dynamo/releases/latest )
24
24
25
25
26
- Dynamo is a flexible, component based, data center scale
27
- inference serving framework designed to leverage the strengths of the
28
- standalone Dynamo Inference Server while expanding its capabilities
29
- to meet the demands of complex use cases including those of Generative
30
- AI. It is designed to enable developers to implement and customize
31
- routing, load balancing, scaling and workflow definitions at the data
32
- center scale without sacrificing performance or ease of use.
26
+ Dynamo is a flexible, component based, data center scale inference
27
+ serving framework designed to meet the demands of complex use cases
28
+ including those of Generative AI. It is designed to enable developers
29
+ to implement and customize routing, load balancing, scaling and
30
+ workflow definitions at the data center scale without sacrificing
31
+ performance or ease of use.
33
32
34
33
> [ !NOTE]
35
34
> This project is currently in the alpha / experimental /
@@ -58,7 +57,10 @@ We provide 3 types of builds:
58
57
59
58
For example, if you want to build a container for the ` STANDARD ` backends you can run
60
59
61
- ` ./container/build.sh `
60
+ <!-- pytest.mark.skip-->
61
+ ``` bash
62
+ ./container/build.sh
63
+ ```
62
64
63
65
Please see the instructions in the corresponding example for specific build instructions.
64
66
@@ -71,24 +73,37 @@ The run script offers a few common workflows:
71
73
72
74
1 . Running a command in a container and exiting.
73
75
74
- ```
76
+ <!-- pytest.mark.skip-->
77
+ ``` bash
75
78
./container/run.sh -- python3 -c " import dynamo.runtime; help(dynamo.runtime)"
76
79
```
80
+ <!--
77
81
78
- 2 . Starting an interactive shell.
82
+ # This tests the above the line but from within the container
83
+ # using pytest-codeblocks
84
+
85
+ ```bash
86
+ python3 -c "import dynamo.runtime; help(dynamo.runtime)"
79
87
```
88
+ -- >
89
+
90
+ 2. Starting an interactive shell.
91
+
92
+ <!--pytest.mark.skip-->
93
+ ``` bash
80
94
./container/run.sh -it
81
95
```
82
96
83
97
3 . Mounting the local workspace and Starting an interactive shell.
84
98
85
- ```
99
+ <!-- pytest.mark.skip-->
100
+ ``` bash
86
101
./container/run.sh -it --mount-workspace
87
102
```
88
103
89
- The last command also passes common environment variables ( ``` -e
90
- HF_TOKEN``` ) and mounts common directories such as ``` /tmp:/tmp`` `,
91
- ``` /mnt:/mnt `` ` .
104
+ The last command also passes common environment variables ( `-e
105
+ HF_TOKEN` ) and mounts common directories such as ` /tmp:/tmp`,
106
+ ` /mnt:/mnt ` .
92
107
93
108
Please see the instructions in the corresponding example for specific
94
109
deployment instructions.
0 commit comments