# HfHubHTTPError: 500 Server Error: Internal Server Error for url: **URL:** \ **Category:** 🤗Hub\ **Created:** [July 26, 2024, 5:46pm UTC](https://discuss.huggingface.co/t/hfhubhttperror-500-server-error-internal-server-error-for-url/99580 "2024-07-26T17:46:37Z")\ **Posts on this page:** 20\ **Page:** 1
**Author:** ![GBaker](https://avatars.discourse-cdn.com/v4/letter/g/e68b1a/32.png) [@GBaker](https://discuss.huggingface.co/u/GBaker)\ **Post date:** [July 26, 2024, 5:46pm UTC](https://discuss.huggingface.co/t/hfhubhttperror-500-server-error-internal-server-error-for-url/99580/1 "2024-07-26T17:46:38Z")
When trying to load newly uploaded datasets using `load_dataset('GBaker/lh_marked_sentence_coref')` I get the following error: ````auto 369 # Convert `HTTPError` into a `HfHubHTTPError` to display request information 370 # as well (request id and/or server error message) --> 371 raise HfHubHTTPError(str(e), response=response) from e 372 373 HfHubHTTPError: 500 Server Error: Internal Server Error for url: https://huggingface.co/api/datasets/GBaker/lh_marked_sentence_coref (Request ID: Root=1-66a3e06f-398c9a801961e61137450cbf;cf0e4b4e-6943-4f1c-8d7c-e726a62a1350) Internal Error - We're working hard to fix this as soon as possible!``` But I am able to load the dataset by cloning the repo, ```git clone https://huggingface.co/datasets/GBaker/lh_marked_sentence_coref.git``` and then calling `load_dataset` directly on the data directory. ```` ---
**Author:** ![neoneye](https://avatars.discourse-cdn.com/v4/letter/n/ee7513/32.png) [@neoneye](https://discuss.huggingface.co/u/neoneye)\ **Post date:** [July 26, 2024, 7:05pm UTC](https://discuss.huggingface.co/t/hfhubhttperror-500-server-error-internal-server-error-for-url/99580/2 "2024-07-26T19:05:06Z")
I’m getting the same error, when I invoke `load_dataset` with my dataset. ```auto /usr/local/lib/python3.10/dist-packages/huggingface_hub/utils/_errors.py in hf_raise_for_status(response, endpoint_name) 369 # Convert `HTTPError` into a `HfHubHTTPError` to display request information 370 # as well (request id and/or server error message) --> 371 raise HfHubHTTPError(str(e), response=response) from e 372 373 HfHubHTTPError: 500 Server Error: Internal Server Error for url: https://huggingface.co/api/datasets/neoneye/simon-arc-shape-v4-rev3 (Request ID: Root=1-66a3f20f-2e729b990853409076fedd4a;dee61d3a-4d7c-4a6b-b200-745b903de953) Internal Error - We're working hard to fix this as soon as possible! ``` # Browser When I access the api in the browser: [https://huggingface.co/api/datasets/neoneye/simon-arc-shape-v4-rev3](https://huggingface.co/api/datasets/neoneye/simon-arc-shape-v4-rev3) ```auto {"error":"Internal Error - We're working hard to fix this as soon as possible!"} ``` ### Request headers ```auto Accept text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,*/*;q=0.8 Accept-Encoding gzip, deflate, br, zstd Accept-Language en-US,en;q=0.5 Connection keep-alive Host huggingface.co Priority u=1 Sec-Fetch-Dest document Sec-Fetch-Mode navigate Sec-Fetch-Site cross-site Upgrade-Insecure-Requests 1 User-Agent Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:127.0) Gecko/20100101 Firefox/127.0 ``` ### Response headers ```auto X-Firefox-Spdy h2 access-control-allow-origin https://huggingface.co access-control-expose-headers X-Repo-Commit,X-Request-Id,X-Error-Code,X-Error-Message,X-Total-Count,ETag,Link,Accept-Ranges,Content-Range content-length 80 content-type application/json; charset=utf-8 cross-origin-opener-policy same-origin date Fri, 26 Jul 2024 19:09:45 GMT etag W/"50-9qrwU+BNI4SD0Fe32p/nofkmv0c" referrer-policy strict-origin-when-cross-origin vary Origin via 1.1 1624c79cd07e6098196697a6a7907e4a.cloudfront.net (CloudFront) x-amz-cf-id SP8E7n5qRaP6i9c9G83dNAiOzJBU4GXSrDRAcVNTomY895K35H0nJQ== x-amz-cf-pop CPH50-C1 x-cache Error from cloudfront x-error-message Internal Error - We're working hard to fix this as soon as possible! x-powered-by huggingface-moon x-request-id Root=1-66a3f479-026417465ef42f49349fdca1 ``` ---
**Author:** ![Alex-xu](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/alex-xu/32/29901_2.png) [@Alex-xu](https://discuss.huggingface.co/u/Alex-xu)\ **Post date:** [July 26, 2024, 8:10pm UTC](https://discuss.huggingface.co/t/hfhubhttperror-500-server-error-internal-server-error-for-url/99580/3 "2024-07-26T20:10:46Z")
Same here. I also ran into this error when try to access my dataset via API. ---
**Author:** ![yuuniverse4444](https://avatars.discourse-cdn.com/v4/letter/y/b5e925/32.png) [@yuuniverse4444](https://discuss.huggingface.co/u/yuuniverse4444)\ **Post date:** [July 26, 2024, 9:27pm UTC](https://discuss.huggingface.co/t/hfhubhttperror-500-server-error-internal-server-error-for-url/99580/4 "2024-07-26T21:27:29Z")
Same error. Please look into it. Code ```from # limit determines how many documents will be streamed (remove for all) # to fetch a specific dump: hf://datasets/HuggingFaceFW/fineweb/data/CC-MAIN-2024-10 # replace "data" with "sample/100BT" to use the 100BT sample data_reader = ParquetReader("hf://datasets/HuggingFaceFW/fineweb/sample/10BT", limit=10) for document in data_reader(): # do something with document print(document) ``` ---
**Author:** ![yyupenn](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/yyupenn/32/29903_2.png) [@yyupenn](https://discuss.huggingface.co/u/yyupenn)\ **Post date:** [July 26, 2024, 10:30pm UTC](https://discuss.huggingface.co/t/hfhubhttperror-500-server-error-internal-server-error-for-url/99580/5 "2024-07-26T22:30:25Z")
Same problem since this morning, cannot access any newly uploaded datasets. ---
**Author:** ![TdL](https://avatars.discourse-cdn.com/v4/letter/t/d6d6ee/32.png) [@TdL](https://discuss.huggingface.co/u/TdL)\ **Post date:** [July 26, 2024, 11:58pm UTC](https://discuss.huggingface.co/t/hfhubhttperror-500-server-error-internal-server-error-for-url/99580/6 "2024-07-26T23:58:06Z")
Same error here,. Please help ---
**Author:** ![hyerong](https://avatars.discourse-cdn.com/v4/letter/h/a6a055/32.png) [@hyerong](https://discuss.huggingface.co/u/hyerong)\ **Post date:** [July 27, 2024, 1:37am UTC](https://discuss.huggingface.co/t/hfhubhttperror-500-server-error-internal-server-error-for-url/99580/7 "2024-07-27T01:37:47Z")
same error now ---
**Author:** ![seansica](https://avatars.discourse-cdn.com/v4/letter/s/cab0a1/32.png) [@seansica](https://discuss.huggingface.co/u/seansica)\ **Post date:** [July 27, 2024, 2:24am UTC](https://discuss.huggingface.co/t/hfhubhttperror-500-server-error-internal-server-error-for-url/99580/8 "2024-07-27T02:24:22Z")
Same error when pulling `monology/pile-uncopyrighted` ```auto HfHubHTTPError: 500 Server Error: Internal Server Error for url: https://huggingface.co/api/datasets/monology/pile-uncopyrighted (Request ID: Root=1-66a4591f-064984386142166a20871761;bf68f7b5-3022-4773-b476-a7410cf305b3) Internal Error - We're working hard to fix this as soon as possible! ``` ---
**Author:** ![rigarashi](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/rigarashi/32/22781_2.png) [@rigarashi](https://discuss.huggingface.co/u/rigarashi)\ **Post date:** [July 27, 2024, 2:32am UTC](https://discuss.huggingface.co/t/hfhubhttperror-500-server-error-internal-server-error-for-url/99580/9 "2024-07-27T02:32:09Z")
I’m getting the same error. I tried - deleting the dataset and create it again - uploading it to a different organisation - changing the data format from`parquet` to `arrow` - recreating the access token that I’m using for HfApi but none of them solved the issue ---
**Author:** ![AXCXEPT](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/axcxept/32/31322_2.png) [@AXCXEPT](https://discuss.huggingface.co/u/AXCXEPT)\ **Post date:** [July 27, 2024, 6:59am UTC](https://discuss.huggingface.co/t/hfhubhttperror-500-server-error-internal-server-error-for-url/99580/10 "2024-07-27T06:59:52Z")
Me too. When I’m iterating, this happens and ruins 30 hours of training: … ---
**Author:** ![neoneye](https://avatars.discourse-cdn.com/v4/letter/n/ee7513/32.png) [@neoneye](https://discuss.huggingface.co/u/neoneye)\ **Post date:** [July 27, 2024, 8:23am UTC](https://discuss.huggingface.co/t/hfhubhttperror-500-server-error-internal-server-error-for-url/99580/11 "2024-07-27T08:23:37Z")
I have created an issue on the [github datasets repo](https://github.com/huggingface/datasets/issues/7079), that links back to this discussion. ---
**Author:** ![mouadenna](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/mouadenna/32/29923_2.png) [@mouadenna](https://discuss.huggingface.co/u/mouadenna)\ **Post date:** [July 27, 2024, 5:52pm UTC](https://discuss.huggingface.co/t/hfhubhttperror-500-server-error-internal-server-error-for-url/99580/12 "2024-07-27T17:52:26Z")
one alternative worked for me : ` !git clone yourdataset\_path dataset = load\_dataset(“parquet”, data\_dir=“yourdataset\_local\_path”) ` ---
**Author:** ![saurabh3669](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/saurabh3669/32/29925_2.png) [@saurabh3669](https://discuss.huggingface.co/u/saurabh3669)\ **Post date:** [July 27, 2024, 7:06pm UTC](https://discuss.huggingface.co/t/hfhubhttperror-500-server-error-internal-server-error-for-url/99580/13 "2024-07-27T19:06:52Z")
I don’t understand what repo to clone. Lets say for ‘[tasksource/icl-symbol-tuning-instruct · Datasets at Hugging Face](https://huggingface.co/datasets/tasksource/icl-symbol-tuning-instruct)’, what do I clone? ---
**Author:** ![0xZee](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/0xzee/32/29926_2.png) [@0xZee](https://discuss.huggingface.co/u/0xZee)\ **Post date:** [July 27, 2024, 7:10pm UTC](https://discuss.huggingface.co/t/hfhubhttperror-500-server-error-internal-server-error-for-url/99580/14 "2024-07-27T19:10:30Z")
Thanks mate ! worked out for me also… seems okay when dataset is local… ---
**Author:** ![0xZee](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/0xzee/32/29926_2.png) [@0xZee](https://discuss.huggingface.co/u/0xZee)\ **Post date:** [July 27, 2024, 7:12pm UTC](https://discuss.huggingface.co/t/hfhubhttperror-500-server-error-internal-server-error-for-url/99580/15 "2024-07-27T19:12:34Z")
Hi, you had to clone the whole url : !git clone [tasksource/icl-symbol-tuning-instruct · Datasets at Hugging Face](https://huggingface.co/datasets/tasksource/icl-symbol-tuning-instruct) ---
**Author:** ![saurabh3669](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/saurabh3669/32/29925_2.png) [@saurabh3669](https://discuss.huggingface.co/u/saurabh3669)\ **Post date:** [July 27, 2024, 7:20pm UTC](https://discuss.huggingface.co/t/hfhubhttperror-500-server-error-internal-server-error-for-url/99580/16 "2024-07-27T19:20:02Z")
Thanks for the help. This worked from datasets import load\_dataset #!git clone [tasksource/icl-symbol-tuning-instruct · Datasets at Hugging Face](https://huggingface.co/datasets/tasksource/icl-symbol-tuning-instruct) ds = load\_dataset(‘parquet’, data\_dir=‘icl-symbol-tuning-instruct’) ---
**Author:** ![lhoestq](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/lhoestq/32/52888_2.png) [@lhoestq](https://discuss.huggingface.co/u/lhoestq)\ **Post date:** [July 27, 2024, 7:37pm UTC](https://discuss.huggingface.co/t/hfhubhttperror-500-server-error-internal-server-error-for-url/99580/17 "2024-07-27T19:37:48Z")
we’re working on a fix ! 🙂 ---
**Author:** ![lhoestq](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/lhoestq/32/52888_2.png) [@lhoestq](https://discuss.huggingface.co/u/lhoestq)\ **Post date:** [July 27, 2024, 7:41pm UTC](https://discuss.huggingface.co/t/hfhubhttperror-500-server-error-internal-server-error-for-url/99580/18 "2024-07-27T19:41:32Z")
We fixed the issue, you can load datasets again, sorry for the inconvenience ! ---
**Author:** ![lhoestq](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/lhoestq/32/52888_2.png) [@lhoestq](https://discuss.huggingface.co/u/lhoestq)\ **Post date:** [July 27, 2024, 7:45pm UTC](https://discuss.huggingface.co/t/hfhubhttperror-500-server-error-internal-server-error-for-url/99580/19 "2024-07-27T19:45:13Z")
(it was an internal bug due to a modification of our dataset tagging system, that was recently updated to detect datasets compatibility with a famous Rust-based DataFrame library - sorry again !) ---
**Author:** ![anas-awadalla](https://avatars.discourse-cdn.com/v4/letter/a/b487fb/32.png) [@anas-awadalla](https://discuss.huggingface.co/u/anas-awadalla)\ **Post date:** [July 27, 2024, 8:20pm UTC](https://discuss.huggingface.co/t/hfhubhttperror-500-server-error-internal-server-error-for-url/99580/20 "2024-07-27T20:20:46Z")
Hello! I am still seeing this issue on some datasets ([https://huggingface.co/datasets/mlfoundations/MINT-1T-HTML](https://huggingface.co/datasets/mlfoundations/MINT-1T-HTML)). [Next page](https://discuss.huggingface.co/t/hfhubhttperror-500-server-error-internal-server-error-for-url/99580.md?page=2)