31 dimensions would be a complete disaster even inside a tiny 8B parameter model. It would assuredly output complete gibberish or fail to function entirely in most regards, 31 is about 4,065 dimensions off, even 8B as example is typically 4,096 dimensions.