[Opinion Card] Human creates with a large context window

Introduction #

People often complain that the context window is too small (or too large?). For fixing small bugs, a small context is enough; but for doing creations, larger context window is beneficial.

Operational work needs precise context #

For problems with a certain answer, the context doesn't have to be large: human finds out the answer from existing knowledge (and documentations). Knowledge and experience also help reducing the search space.

Creative work needs large context #

For tasks without a certain answer, human may need to compose the answer by searching the map for components of an (not the ) answer. The human's knowledge and experience determine the size and shape of the map. Because answer generating requires multiple components, the search space is usually much larger.

There is a difference for creative work searches from operation work search: the search space expands, not shrinks, as the human finds more potentially useful components.

Larger context allows for wilder imaginations #

Since the task is a search, a bigger map allows for more diverse answers. Needless to say, the complexity, difficulty, and scope of the search also expand as the map enlarges.

Unlike parameters, the link is dynamic #

Reader may think human's experience is not like the context, but more of the parameters in a model. I don't think it's true. Human's observation of their experience is not fixed. One may love a song in one day and hate the same song in another.

添加评论
点赞收藏
点踩分享查看原文
评论
?
参与讨论