allennlp.modules.text_field_embedders

A TextFieldEmbedder is a Module that takes as input the dict of NumPy arrays produced by a TextField and returns as output an embedded representation of the tokens in that field.

• TextFieldEmbedder
• BasicTextFieldEmbedder

class allennlp.modules.text_field_embedders.text_field_embedder.TextFieldEmbedder

Bases: torch.nn.modules.module.Module, allennlp.common.registrable.Registrable

A TextFieldEmbedder is a Module that takes as input the DataArray produced by a TextField and returns as output an embedded representation of the tokens in that field.

The DataArrays produced by TextFields are dictionaries with named representations, like “words” and “characters”. When you create a TextField, you pass in a dictionary of TokenIndexer objects, telling the field how exactly the tokens in the field should be represented. This class changes the type signature of Module.forward, restricting TextFieldEmbedders to take inputs corresponding to a single TextField, which is a dictionary of tensors with the same names as were passed to the TextField.

We also add a method to the basic Module API: get_output_dim(). You might need this if you want to construct a Linear layer using the output of this embedder, for instance.

default_implementation = 'basic'

forward(text_field_input: typing.Dict[str, torch.FloatTensor], num_wrapping_dims: int = 0) → torch.FloatTensor

Parameters:

text_field_input : Dict[str, torch.Tensor]

A dictionary that was the output of a call to TextField.as_tensor. Each tensor in here is assumed to have a shape roughly similar to (batch_size, sequence_length) (perhaps with an extra trailing dimension for the characters in each token).

num_wrapping_dims : int, optional (default=0)

If you have a ListField[TextField] that created the text_field_input, you’ll end up with tensors of shape (batch_size, wrapping_dim1, wrapping_dim2, ..., sequence_length). This parameter tells us how many wrapping dimensions there are, so that we can correctly TimeDistribute the embedding of each named representation.

classmethod from_params(vocab: allennlp.data.vocabulary.Vocabulary, params: allennlp.common.params.Params) → allennlp.modules.text_field_embedders.text_field_embedder.TextFieldEmbedder

get_output_dim() → int

Returns the dimension of the vector representing each token in the output of this TextFieldEmbedder. This is not the shape of the returned tensor, but the last element of that shape.

class allennlp.modules.text_field_embedders.basic_text_field_embedder.BasicTextFieldEmbedder(token_embedders: typing.Dict[str, allennlp.modules.token_embedders.token_embedder.TokenEmbedder]) → None

Bases: allennlp.modules.text_field_embedders.text_field_embedder.TextFieldEmbedder

This is a TextFieldEmbedder that wraps a collection of TokenEmbedder objects. Each TokenEmbedder embeds or encodes the representation output from one TokenIndexer. As the data produced by a TextField is a dictionary mapping names to these representations, we take TokenEmbedders with corresponding names. Each TokenEmbedders embeds its input, and the result is concatenated in an arbitrary order.

forward(text_field_input: typing.Dict[str, torch.FloatTensor], num_wrapping_dims: int = 0) → torch.FloatTensor

classmethod from_params(vocab: allennlp.data.vocabulary.Vocabulary, params: allennlp.common.params.Params) → allennlp.modules.text_field_embedders.basic_text_field_embedder.BasicTextFieldEmbedder

get_output_dim() → int

Returns the dimension of the vector representing each token in the output of this TextFieldEmbedder. This is not the shape of the returned tensor, but the last element of that shape.