# Changing of value in Config file

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fchanging-of-value-in-config-file%2F22246%3E%5C
**Category:** Beginners\
**Created:** [August 29, 2022, 5:01am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fchanging-of-value-in-config-file%2F22246 "2022-08-29T05:01:33Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![tejan-rgb](https://avatars.discourse-cdn.com/v4/letter/t/ecd19e/32.png) [@tejan-rgb](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Ftejan-rgb)%5C
**Post date:** [August 29, 2022, 5:01am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fchanging-of-value-in-config-file%2F22246%2F1 "2022-08-29T05:01:33Z")

</div>

Hi,

After loading the model through

```auto
config = BertConfig()
model = BertModel(config)

```

I try to change the `hidden_size` parameter in the configuration of the Bert model as

```auto
model.config.hidden_size = 800

```

The default hidden\_size of Bert is 768.

Now, after loading some inputs to the model, I am still getting a hidden\_size value of 768, Why?

```auto
inputs = torch.tensor([[101, 7592, 999, 102],
        [101, 4658, 1012, 102],
        [101, 3835, 999, 102]])

output = model(inputs)

```

Now, when I do  
`output.last_hidden_state.shape`  
it prints `torch.Size([3, 4, 768])`

Can somebody please explain why it’s still using 768 as its hidden\_size?

Thanks.
