Kilburnie, believed to be the oldest surviving dwelling in Lancaster, South Carolina, began as a federal-style cottage built about 1827 by Lancaster dentist Joseph Lee. Ann Beard Phifer-Crawford, daughter of Elizabeth Locke and Col. Martin Phifer and recent widow of John Crawford of the Waxhaws, purchased the property on North White Street in 1834, probably provided its name honoring her husband, after the ancestral home of the Crawford's, Kilbirnie Castle in the Parish of Kilbirnie, Scotland. She added a second story and piazza to the house thereby transforming Kilburnie into a Greek Revival structure, giving it the style of Robert Mills' splendid courthouse nearby. Its "grounds" were the entire east block of North White Street, bordered by Meeting and Barr Streets. In February 1865, the federal army occupied Lancasterville, and surviving letters describe how the Crawford family hid in the attic, watching the Union Calvary ride into town.

Kilburnie was sold to John D. Wylie in 1869, who rented the house to a number of families over the years, including William and Julliet Boyd Drennan - whose daughter Amanda married John Edgar Craig at Kilburnie in 1883. The building's current owner is one of that couple's descendants. Kilburnie was deeded in 1898 to Wardlaw T. Witherspoon, who embellished the exterior with Victorian ornamentation. In 1909, the dwelling passed into the ownership of Miss Annie Witherspoon, a member of the old Presbyterian Church whose Missionary Band of children met at Kilburnie every month. In 1926, Kilburnie was sold to Mrs. Essie M. Williams, who with her husband William Greene Williams restored the dwelling and resided in it until the late 1950s.

Kilburnie was listed on the National Register of Historic Places in 1979, its significant antebellum architecture being described as "outstanding in its style and grace." After standing vacant for nearly forty years, Kilburnie was faced with demolition in 1998. With the encouragement of numerous Lancastrians, it was rescued by John E. Craig, Jr. and Johannes L. M. Tromp, who moved the structure on February 6, 1999 to historic Craig Farm just north of Lancaster. The meticulous restoration of the old structure and construction of an architecturally sympathetic rear addition included faithful copying of the parlor's original elaborately modeled ceiling in the restored parlor and dining room.

At the official opening ceremony on May 21, 2000, South Carolina Governor Jim Hodges cut the ribbon opening Kilburnie, the Inn at Craig Farm, and with his wife Rachel and sons, joined Lancastrians in celebrating the restoration of a much-loved structure.

Kilburnie is now a celebrated bed and breakfast with rooms named for the personalities and families of old Lancaster County history and the building's architectural forbears. Each guest room features a collection of prints, maps, and paintings reflective of its namesake's life, and the public halls feature artist Jim Shore's paintings based on historic events in Lancaster. The owners' hope is that guests will encourage friends, relatives, and business associates to think of Kilburnie, the Inn at Craig Farm, as a "home away from home"- a place to step back in time and history, in the quiet and comfort of a unique private dwelling.