The main thing is not to rush into a decision, but to discuss in detail with the geneticist what exactly the "borderline" test results mean and why they need additional information to clarify things. Your doctor isn't recommending an invasive procedure for nothing: if a non-invasive test gave an ambiguous result, it really could indicate the need to get a more accurate answer. Ask the specialist what specific chromosomal abnormalities are concerning them, how likely the problems are, and how this might affect pregnancy management and delivery.
There is a risk of miscarriage with cordocentesis, but it's small, and modern clinics with experienced specialists minimize such complications. However, this remains a choice that depends on you. Some parents prefer to live with uncertainty and give birth while preparing for possible problems. Others want to know the diagnosis for sure in advance so they can prepare mentally and medically. Both approaches are valid.
Ask the geneticist to help you weigh things in your specific situation: how likely is serious pathology, how will it affect the course of pregnancy and your child's life, is the information worth the risk of the procedure. While you're at it, find out if it's possible to have the test done at a center with maximum experience and a low complication rate.