User:David MacQuigg/Sender Policy Framework

Definition: Method for authenticating the return address on an email message.

See also: Email authentication for a general overview and terminology.

Sender Policy Framework (SPF) is an email authentication method that seeks to correlate the domain name in the envelope return address with the IP address of an SMTP client currently connected and waiting to send a message. A definite result (Pass or Fail) will allow the disposition of the message to be determined quickly, while the client is still connected, and before transferring the message data.

After accepting the Mail From: command, the server does a DNS query for an SPF record on the domain name. If the IP address is listed in the SPF record, the authentication result is PASS, the message may be processed in accordance with the reputation assigned to the domain. If the authentication result is FAIL, the message may be immediately rejected without any data transfer.

Limitations

Often, the result of an SPF authenticaion is neither PASS nor FAIL, but NEUTRAL. This is due to the many domains that don't publish SPF records, or that have records giving indefinite results.

forwarding problem

How it works

This is a brief explanation of an authentication using an SPF record with just a few of the more common terms. See RFC-4408 for the other terms and full details of SPF.

Senders that wish to use SPF should publish a TXT record and an identical SPF record under their domain name in DNS. Typical DNS records might look like:

example.com.  1800  IN  TXT  "v=spf1 ip4:192.168.33.32/28 mx a:colo.example.net ?all"
example.com.  1800  IN  SPF  "v=spf1 ip4:192.168.33.32/28 mx a:colo.example.net ?all"

These records authorize a number of IP addresses to transmit email for example.com. These addresses include a block of 16 starting at 192.168.33.32, plus any addresses found via the MX records for that same domain (i.e. the incoming mail servers), plus any addresses found in A records for the domain colo.example.net. The ?all term at the end means to treat all other addresses as "neutral", meaning the same as if no SPF records were published.

1) The sender (typically the Mail Submission Agent for example.com) checks the envelope return address to make sure the domain part is "example.com", then relays the message to the Transmitter.

2) The Receiver extracts the domain part of the return address, and does a DNS query (preferably for the SPF record) under that domain.

  MAIL FROM:<author@example.com>

3) The terms in the SPF record are tested one at a time, left to right, and the first definite result (pass or fail) is accepted. The prefixes (+, -, ?) mean (pass, fail, neutral), with + being the default.

4) The Receiver adds an authentication header to the message:

  Received-SPF: Pass (mx1.example.org: domain of
   myname@example.com designates 192.168.33.35 as permitted sender)
      receiver=mx1.example.org; client-ip=192.168.33.35;
      envelope-from=<myname@example.com>; helo=foo.example.com;

5) If the message is forwarded. the forwarder is expected to rewrite the envelope return address so that an SPF check won't fail when the message is forwarded to the next agent. This is done using a related protocol, the Sender Rewriting Scheme (SRS). In this scheme, the forwarder's domain name is substituted for the domain part of the original, and the local part is a concatenation of various strings joined with = characters. These strings include authentication codes and the original return address.

 original:   MAIL FROM:<author@example.com>
 rewritten:  MAIL FROM:<SRS0+yf09=Cw=example.com=author@forwarder.com>

Explanatory notes

TXT is the code for a text record in DNS. Text records can store any text strings the domain owner wants to publish. SPF is a new record type, a TXT record just for SPF data. It will be necessary to publish both records until all DNS software is able to recognize the new type.

1800 seconds is the lifetime of the DNS record after it has left the server on which it was published. This allows frequently used records to be read from a cache, instead of doing a fresh query every time.

Everything between the double quotes is part of the text string, but not the quotes themselves. The string consists of a number of space-delimited terms. "v=spf1" means this is a record for version 1 of SPF.

The syntax for SPF includes a number of key=value pairs (or key:value). This syntax takes a little more space, but it allows for future growth of SPF by simply adding new key items.

The /28 in the ip4 terms is CIDR notation for a block of 16 addresses. The number 28 is the number of bits in a "mask", which is a bit pattern used in testing address ranges. Comparisons using a mask are faster than a general integer range test, but the blocks are limited to sizes that are a power of two (1, 2, 4, 8, 16, ...). CIDR notation is commonly used in routers, where speed is critical.

Bibliography

• [RFC-4408] [r]: Add brief definition or description - "Sender Policy Framework (SPF) for Authorizing Use of Domains in E-Mail, Version 1", M. Wong, W. Schlitt, 2006.
• [Sender Policy Framework] [r]: Add brief definition or description - project website
• [Sender Rewriting Scheme] [r]: Add brief definition or description - website for SRS