# Input area size for gpt-j model

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Finput-area-size-for-gpt-j-model%2F20782%3E%5C
**Category:** Beginners\
**Created:** [July 24, 2022, 1:07pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Finput-area-size-for-gpt-j-model%2F20782 "2022-07-24T13:07:34Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![DLiebman](https://avatars.discourse-cdn.com/v4/letter/d/e9c0ed/32.png) [@DLiebman](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FDLiebman)%5C
**Post date:** [July 24, 2022, 1:07pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Finput-area-size-for-gpt-j-model%2F20782%2F1 "2022-07-24T13:07:34Z")

</div>

How do I find the maximum number of tokens for the input area of a model like gpt-j ? I am looking at the model card, but I do not know how to read it properly. I am interested in gpt-j, and I think the size of the input area is either 2048 or 4096. I think when the input gets bigger than this many tokens the input area starts ‘windowing’. Correct me but I think the start of the input is read by the model but is scrolled through so that the end of the input can be read.

> **[EleutherAI/gpt-j-6B · Hugging Face](https://huggingface.co/EleutherAI/gpt-j-6B)**
>
> We’re on a journey to advance and democratize artificial intelligence through open source and open science.

I am looking at this page. There is a chart on the left. Maybe someone can point out a description of this kind of chart on another page?