OpenAI: Stream interrupted (client disconnected) - openai-api

Question

I'm trying OpenAI.
I have prepared the training data, and used fine_tunes.create. Several minutes later, it showed Stream interrupted (client disconnected).
$ openai api fine_tunes.create -t data_prepared.jsonl
Upload progress: 100%|██████████████████████████████████████████████| 47.2k/47.2k [00:00<00:00, 44.3Mit/s]
Uploaded file from data_prepared.jsonl: file-r6dbTH7rVsp6jJMgbX0L0bZx
Created fine-tune: ft-JRGzkYfXm7wnScUxRSBA2M2h
Streaming events until fine-tuning is complete...
(Ctrl-C will interrupt the stream, but not cancel the fine-tune)
[2022-12-02 11:10:08] Created fine-tune: ft-JRGzkYfXm7wnScUxRSBA2M2h
[2022-12-02 11:10:23] Fine-tune costs $0.06
[2022-12-02 11:10:24] Fine-tune enqueued. Queue number: 11
Stream interrupted (client disconnected).
To resume the stream, run:
openai api fine_tunes.follow -i ft-JRGzkYfXm7wnScUxRSBA2M2h
I tried fine_tunes.follow, several minutes later, it still failed:
$ openai api fine_tunes.follow -i ft-JRGzkYfXm7wnScUxRSBA2M2h
[2022-12-02 11:10:08] Created fine-tune: ft-JRGzkYfXm7wnScUxRSBA2M2h
[2022-12-02 11:10:23] Fine-tune costs $0.06
[2022-12-02 11:10:24] Fine-tune enqueued. Queue number: 11
Stream interrupted (client disconnected).
To resume the stream, run:
openai api fine_tunes.follow -i ft-JRGzkYfXm7wnScUxRSBA2M2h
openai api fine_tunes.list showed:
$ openai api fine_tunes.list
{
"data": [
{
"created_at": 1669975808,
"fine_tuned_model": null,
"hyperparams": {
"batch_size": 2,
"learning_rate_multiplier": 0.1,
"n_epochs": 4,
"prompt_loss_weight": 0.01
},
"id": "ft-JRGzkYfXm7wnScUxRSBA2M2h",
"model": "curie",
"object": "fine-tune",
"organization_id": "org-YyoQqNIrjGHYDnKt9t3T6x2J",
"result_files": [],
"status": "pending",
"training_files": [
{
"bytes": 47174,
"created_at": 1669975808,
"filename": "data_prepared.jsonl",
"id": "file-r6dbTH7rVsp6jJMgbX0L0bZx",
"object": "file",
"purpose": "fine-tune",
"status": "processed",
"status_details": null
}
],
"updated_at": 1669975824,
"validation_files": []
}
],
"object": "list"
}
And $ openai api completions.create -m ft-JRGzkYfXm7wnScUxRSBA2M2h -p aprompt returned Error: That model does not exist (HTTP status code: 404).
Could anyone help?

Answer 1

Apparently, there is a problem with the OpenAI API. (see: this reddit post and this issue on Git) I downgraded my version to v.0.25 by running
pip install openai==0.25.0
That fixed it for me. Although, to be fair, you can expect this to be fixed in the future.

Answer 2

It was a temporary issue of OpenAI, the team fixed that.