Application Process
To connect Ace Data Cloud in AnythingLLM, first go to the Ace Data Cloud Console, obtain your API Token, and keep it for later use.
If you have not logged in or registered yet, you will be automatically redirected to the login page and invited to register and log in. After logging in or registering, you will automatically return to the current page.
When applying for the first time, free credits will be provided, allowing you to experience Ace Data Cloud’s model services for free.
Download AnythingLLM
For personal use, you can download the desktop version. The vector database (LanceDB) runs locally, document searching is completely offline, and the network is used only when calling models; for team multi-user scenarios, use Docker deployment.Configure the Conversational Model
Start AnythingLLM, go to Settings → LLM Preference, and select OpenAI (Generic) as the Provider (do not select regular OpenAI, which is fixed toapi.openai.com and has no custom Base URL). For official documentation, see OpenAI (Generic) LLM Provider.
Model capabilities and context limits are subject to the current model directory.Note the Base URL path rules:
Configure the Embedding Model
The core of AnythingLLM is RAG, which requires an embedding model to vectorize documents. Its Embedding Preference and LLM Preference are two independent sets of configurations—see Embedder Configuration Overview. Its built-in AnythingLLM Embedder (Built-in / Native) runs directly locally, works out of the box with zero configuration, and is the default and recommended choice: Go to Settings → Embedding Preference, keep the Provider as the default AnythingLLM Embedder, and no key needs to be filled in. It completes document vectorization locally, with both the original text and vectors stored in the local LanceDB and not uploaded to the cloud.AnythingLLM’s Embedder options (cloud: OpenAI / Azure OpenAI / Cohere; local: Built-in, LM Studio, LocalAI, Ollama) are all integrated according to their respective fixed forms. Among them, cloud OpenAI embeddings are fixed toapi.openai.comand do not support a custom Base URL; if you want to use a custom endpoint, you can use the Generic OpenAI Embedder (which also has a Base URL field and can point to Ace Data Cloud’stext-embedding-3-large) or the local LocalAI Embedder. In this article, the conversational model uses Ace Data Cloud, while embeddings use AnythingLLM’s built-in local Embedder, and the two do not affect each other.
Select a Model
The model directory will continue to be updated. Prioritize the model list automatically loaded by the client; when manual entry is needed, first requestGET https://api.acedata.cloud/v1/models to obtain the current model ID, then select according to the context, image, and tool-calling capabilities supported by the client.
Verify the Integration
If you are unsure whether the issue is with AnythingLLM or the network, you can first use curl to directly verify the endpoint (replace{token} with your Token):
chat.completion object indicates that both the Token and endpoint are ready; if HTTP 403 used_up is returned, it means the Token is valid but the balance is insufficient, and you can top up in the console.
Advanced: Workspace and Document Conversations
After creating a new Workspace, upload documents such as PDF / Word / Markdown. AnythingLLM will split them by paragraphs, use the local Embedder to generate vectors, and store them in the local LanceDB. During a conversation, it will first retrieve relevant segments, then pass the segments together with your question to the conversational model (that is, Ace Data Cloud) for an answer, and cite the source below the answer. At the top of each Workspace, you can switch between Query mode (answers based only on documents) and Chat mode (mixes general knowledge); for serious scenarios, it is recommended to use Query mode to avoid hallucinations. During Docker deployment, environment variables such asGENERIC_OPEN_AI_BASE_PATH, GENERIC_OPEN_AI_API_KEY, and GENERIC_OPEN_AI_MODEL_PREF can be used to preset the same conversational model integration and enable multi-user mode.
Frequently Asked Questions
Prompt 404 / connection fail
Usually, the Base URL was written as.../openai/v1 or /v1 was omitted. Change it to https://api.acedata.cloud/v1.
Unable to converse after uploading documents
Please confirm that an available Embedder is selected in Settings → Embedding Preference (the default AnythingLLM Embedder can run locally and requires no additional configuration), and re-upload the documents to generate vectors.Prompt 401 Unauthorized
Please confirm that the API Key contains the Ace Data Cloud Token (without theBearer prefix and without extra spaces), and that the corresponding application’s balance is sufficient.