The investigational anti-cancer drugs being studied are called amivantamab (JNJ-61186372) and lazertinib (JNJ-73841937). They are being developed for the treatment of locally advanced or metastatic (i.e., spread outside your lungs) non-small cell lung cancer NSCLC. There are 4 treatments (regimens) that will be used in this study: amivantamab alone, amivantamab in combination with lazertinib, amivantamab in combination with chemotherapy and amivantamab in combination with lazertinib and chemotherapy. The use of the study drugs together and in combination with other chemotherapy is also considered investigational. The purpose of this study is to see if subcutaneous (under the skin) amivantamab via manual injection, with or without lazertinib and chemotherapy administered in various combinations is useful and safe for treating patients with NSCLC with specific mutations in the EGFR gene.