The incidence rate of prostate cancer (PCa) has risen by 3% per year from 2014 through 2019 in the United States. An estimated 34,700 people will die from PCa in 2023, corresponding to 95 deaths per day. Castration resistant prostate cancer (CRPC) is the leading cause of deaths among men with PCa. Androgen receptor (AR) plays a critical role in the development of CRPC. N-terminal domain (NTD) is the essential functional domain for AR transcriptional activation, in which modular activation function-1 (AF-1) is important for gene regulation and protein interactions. Over last 2 decades drug discovery against NTD has attracted interest for CRPC treatment. However, NTD is an intrinsically disordered domain without stable three-dimensional structure, which has so far hampered the development of drugs targeting this highly dynamic structure. Employing high throughput cell-based assays, small-molecule NTD inhibitors exhibit a variety of unexpected properties, ranging from specific binding to NTD, blocking AR transactivation, and suppressing oncogenic proliferation, which prompts its evaluation in clinical trials. Furthermore, molecular dynamics simulations reveal that compounds can induce the formation of collapsed helical states. Nevertheless, our knowledge of NTD structure has been limited to the primary sequence of amino acid chain and a few secondary structure motif, acting as a barrier for computational and pharmaceutical analysis to decipher dynamic conformation and drug-target interaction. In this review, we provide an overview on the sequence-structure-function relationships of NTD, including the polymorphism of mono-amino acid repeats, functional elements for transcription regulation, and modeled tertiary structure of NTD. Moreover, we summarize the activities and therapeutic potential of current NTD-targeting inhibitors and outline different experimental methods contributing to screening novel compounds. Finally, we discuss current directions for structure-based drug design and potential breakthroughs for exploring pharmacological motifs and pockets in NTD, which could contribute to the discovery of new NTD inhibitors.