Roll oyster crackers very fine. Put in a pan a layer of oysters, cover not too thickly with crackers, season with salt, pepper and butter, then another layer of oysters and another layer of crackers and so on until the pan is full. Be sure to have the last layer of crackers. Just before putting in the oven, make a hole in the center of the dish and pour in one cup of sweet milk. Bake in a hot oven until cooked entirely through and nicely browned on top.