Skip to content

Commit 63db7bc

Browse files
Milvus-doc-botMilvus-doc-bot
authored andcommitted
Generate en docs
1 parent 2452ae3 commit 63db7bc

File tree

2 files changed

+40
-2
lines changed

2 files changed

+40
-2
lines changed
Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1 +1 @@
1-
{"codeList":["{\n \"registry-mirrors\": [\"https://registry.docker-cn.com\"]\n}\n","$ lscpu | grep -e sse4_2 -e avx -e avx2 -e avx512\n","pip install --upgrade pymilvus\n","pip install pymilvus>=2.4.2\n","# Python Example: result of len() str cannot be used as \"max-length\" in Milvus \n>>> s = \"你好,世界!\"\n>>> len(s) # Number of characters of s.\n6\n>>> len(bytes(s, \"utf-8\")) # Size in bytes of s, max-length in Milvus.\n18\n","pip install pymilvus>=2.4.2\n"],"headingContent":"Operational FAQ","anchorList":[{"label":"Operational FAQ","href":"Operational-FAQ","type":1,"isActive":false}]}
1+
{"codeList":["./birdwatcher\n# Find delegator nodes for your collection\nMilvus(my-release) > show segment-loaded-grpc --collection <your-collectionID>\n\nServerID 2\nChannel by-dev-rootcoord-dml_2, collection: 430123456789, version 1\nLeader view for channel: by-dev-rootcoord-dml_2\nGrowing segments count: 1, ids: [430123456789_4]\n\n# Map server ID to pod IP\nMilvus(my-release) > show session\n\nNode(s) querynode\n ID: 1 Version: 2.4.0 Address: 10.0.0.4:19530\n ID: 2 Version: 2.4.0 Address: 10.0.0.5:19530\n ID: 3 Version: 2.4.0 Address: 10.0.0.6:19530\n","./birdwatcher\nOffline > connect --etcd <your-etcd-ip>:2379 --auto\n\n# Change delegatorMemoryOverloadFactor to 0.3 without restart, default value is 0.1\nset config-etcd --key queryCoord.delegatorMemoryOverloadFactor --value 0.3\n","{\n \"registry-mirrors\": [\"https://registry.docker-cn.com\"]\n}\n","$ lscpu | grep -e sse4_2 -e avx -e avx2 -e avx512\n","pip install --upgrade pymilvus\n","pip install pymilvus>=2.4.2\n","# Python Example: result of len() str cannot be used as \"max-length\" in Milvus \n>>> s = \"你好,世界!\"\n>>> len(s) # Number of characters of s.\n6\n>>> len(bytes(s, \"utf-8\")) # Size in bytes of s, max-length in Milvus.\n18\n","pip install pymilvus>=2.4.2\n"],"headingContent":"Operational FAQ","anchorList":[{"label":"Operational FAQ","href":"Operational-FAQ","type":1,"isActive":false}]}

localization/v2.6.x/site/en/faq/operational_faq.md

Lines changed: 39 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -18,7 +18,45 @@ title: Operational FAQ
1818
d="M4 9h1v1H4c-1.5 0-3-1.69-3-3.5S2.55 3 4 3h4c1.45 0 3 1.69 3 3.5 0 1.41-.91 2.72-2 3.25V8.59c.58-.45 1-1.27 1-2.09C10 5.22 8.98 4 8 4H4c-.98 0-2 1.22-2 2.5S3 9 4 9zm9-3h-1v1h1c1 0 2 1.22 2 2.5S13.98 12 13 12H9c-.98 0-2-1.22-2-2.5 0-.83.42-1.64 1-2.09V6.25c-1.09.53-2 1.84-2 3.25C6 11.31 7.55 13 9 13h4c1.45 0 3-1.69 3-3.5S14.5 6 13 6z"
1919
></path>
2020
</svg>
21-
</button></h1><h4 id="What-if-I-failed-to-pull-the-Milvus-Docker-image-from-Docker-Hub" class="common-anchor-header">What if I failed to pull the Milvus Docker image from Docker Hub?</h4><p>If you failed to pull the Milvus Docker image from Docker Hub, try adding other registry mirrors.</p>
21+
</button></h1><h4 id="What-is-a-QueryNode-delegator-and-what-are-its-responsibilities" class="common-anchor-header">What is a QueryNode delegator, and what are its responsibilities?</h4><p>When a collection loads, a QueryNode subscribes to DML channels for insert and delete messages coming from the message queue. The QueryNode that subscribes to these channels, known as the delegator, is responsible for:</p>
22+
<ul>
23+
<li>Managing increasing segments that require additional memory because of ongoing inserts.</li>
24+
<li>Receiving delete messages and passing them to other QueryNodes that hold the relevant segments.</li>
25+
</ul>
26+
<h4 id="How-to-identify-delegator-nodes-for-a-collection" class="common-anchor-header">How to identify delegator nodes for a collection?</h4><p>Use Birdwatcher.</p>
27+
<p>Install Birdwatcher following <a href="https://milvus.io/docs/birdwatcher_install_guides.md#Install-Birdwatcher">this</a>, then run the following command:</p>
28+
<pre><code translate="no" class="language-shell">./birdwatcher
29+
<span class="hljs-meta prompt_"># </span><span class="language-bash">Find delegator nodes <span class="hljs-keyword">for</span> your collection</span>
30+
Milvus(my-release) &gt; show segment-loaded-grpc --collection &lt;your-collectionID&gt;
31+
32+
ServerID 2
33+
Channel by-dev-rootcoord-dml_2, collection: 430123456789, version 1
34+
Leader view for channel: by-dev-rootcoord-dml_2
35+
Growing segments count: 1, ids: [430123456789_4]
36+
<span class="hljs-meta prompt_">
37+
# </span><span class="language-bash">Map server ID to pod IP</span>
38+
Milvus(my-release) &gt; show session
39+
40+
Node(s) querynode
41+
ID: 1 Version: 2.4.0 Address: 10.0.0.4:19530
42+
ID: 2 Version: 2.4.0 Address: 10.0.0.5:19530
43+
ID: 3 Version: 2.4.0 Address: 10.0.0.6:19530
44+
<button class="copy-code-btn"></button></code></pre>
45+
<h4 id="What-parameters-can-be-adjusted-if-query-node-memory-usage-is-unbalanced" class="common-anchor-header">What parameters can be adjusted if query node memory usage is unbalanced?</h4><p>Sometimes, query node memory varies because some act as delegators using more RAM. If a delegator’s memory is high, adjust queryCoord.delegatorMemoryOverloadFactor to offload sealed segments to other nodes and reduce RAM usage.</p>
46+
<ul>
47+
<li>The default value is 0.1.</li>
48+
<li>Increasing this value (e.g., to 0.3 or higher) will cause the system to offload more sealed segments from the overloaded delegator to other QueryNodes, helping balance memory usage. And you can also try to increase value up to 1, which means no sealed segments will be loaded in the delegator nodes.</li>
49+
</ul>
50+
<p>If you don’t want to restart the cluster, you can modify milvus config with birdwatcher:</p>
51+
<pre><code translate="no">.<span class="hljs-operator">/</span>birdwatcher
52+
Offline <span class="hljs-operator">&gt;</span> <span class="hljs-keyword">connect</span> <span class="hljs-comment">--etcd &lt;your-etcd-ip&gt;:2379 --auto</span>
53+
54+
# Change delegatorMemoryOverloadFactor <span class="hljs-keyword">to</span> <span class="hljs-number">0.3</span> <span class="hljs-keyword">without</span> restart, <span class="hljs-keyword">default</span> <span class="hljs-keyword">value</span> <span class="hljs-keyword">is</span> <span class="hljs-number">0.1</span>
55+
<span class="hljs-keyword">set</span> config<span class="hljs-operator">-</span>etcd <span class="hljs-comment">--key queryCoord.delegatorMemoryOverloadFactor --value 0.3</span>
56+
<button class="copy-code-btn"></button></code></pre>
57+
<h4 id="How-to-set-shardnum-for-a-collection" class="common-anchor-header">How to set shard_num for a collection?</h4><p>As a best practice, for a collection with vectors of dimension 768, it is recommended to use at least 1 shard per ~100 million vectors. For heavy write use case, use 4 shards per ~100 million vectors.</p>
58+
<p>E.g. if you have 100 million vectors, use 1-4 shards. If you have 500m vectors, use 5-10 shards.</p>
59+
<h4 id="What-if-I-failed-to-pull-the-Milvus-Docker-image-from-Docker-Hub" class="common-anchor-header">What if I failed to pull the Milvus Docker image from Docker Hub?</h4><p>If you failed to pull the Milvus Docker image from Docker Hub, try adding other registry mirrors.</p>
2260
<p>Users from Mainland China can add the URL “https://registry.docker-cn.com” to the registry-mirrors array in <strong>/etc.docker/daemon.json</strong>.</p>
2361
<pre><code translate="no"><span class="hljs-punctuation">{</span>
2462
<span class="hljs-attr">&quot;registry-mirrors&quot;</span><span class="hljs-punctuation">:</span> <span class="hljs-punctuation">[</span><span class="hljs-string">&quot;https://registry.docker-cn.com&quot;</span><span class="hljs-punctuation">]</span>

0 commit comments

Comments
 (0)